Ansible: Failed to connect to the host via ssh

Question

I created a SSH key-pair using the following command: ssh-keygen -t rsa -C "remote-user" -b 4096

I saved the key pair inside ~/.ssh