git push from a remote machine accessed through ssh gives “Permission denied (publickey)” error

Question

To explain my situation, suppose I have PC1 and PC2.

I have a git repo in PC2, and I\'ve set up a ssh key so I won\'t have to enter my credentials when doing git push