Pytorch automatic mixed precision (amp) backward getting slower over the batches

Question

Does anyone have the same problem as mine when enabling pytorch amp, the training over batches are getting slower and slower? Sometimes it starts with the 9th batch.

I fo