PyTorch GPU memory leak during inference

Question

I am trying to encode documents sentence-wise with a huggingface transformer module. I\'m using the very small google/bert_uncased_L-2_H-128_A-2 pretrained model wi