Tensorflow slower on Local GPU than Colab GPU on LSTM

Question

There are many issues about Colab GPU being slower, but in my case, its the opposite. I tried training an LSTM with tensorflow 2.4.0 on -

1. My local GPU - NVIDIA