I too wanted to login without the Minikube command. I found that it drops the SSH key it generates into ~/.minikube/machines//id_rsa.
My machine was named the default "minikube", and therefore I could do:
ssh -i ~/.minikube/machines/minikube/id_rsa docker@$(minikube ip)