Custom loss function in PyTorch - exploding loss in simple MSE example

Question

Before working on something more complex, where I knew I would have to implement my own backward pass, I wanted to try something nice and simple. So, I tried to do