How to avoid OOM errors in repeated training and prediction in TensorFlow?

Question

I have some code in TensorFlow which takes a base model, fine-tunes (trains) it with some data, and then uses the model to predict() using some other data. All this