Linear memory increase proportional to number of times Model.fit is called

Question

I\'m using tensorflow with custom model to train some ai, and I\'m having memory problems. My model consists of 3 different layers that each takes in and processes different inf