Calling .backward() function for two different neural networks but getting retain_graph=True error

Question

I have an Actor Critic neural network where the Actor is its own class and the Critic is its own class with its own neural network and .forward() function. I then am creating an