Does using FP16 help accelerate generation? (HuggingFace BART)

Question

I follow the guide below to use FP16 in PyTorch. https://pytorch.org/blog/accelerating-training-on-nvidia-gpus-with-pytorch-automatic-mixed-precision/

Basically, I\'m usi