Here is my setup:
If you are running jenkins as a service in windows, you need to verify the user running the service. If you created the keys using the user "MACHINENAME\user", change the service so the user running it can match
To check are the following:
After all checks -> try ssh -vvv git@github.com Dont try to do config in jenkins until ssh works!