Installing Nvidia Driver 455.45.01 on Feddora 33 causes high CPU usage from Xorg and nvidia drivers

Question

Updating from Linux kernel 5.6 to 5.9, I noticed the mouse start to lag. I checked in top and both Xorg and the new Nvidia Driver I had installed (455.45.01-3.fc33) were con