Went through a lot of questions, but nothing seems to be solving my issue. Or to be more precise I am not sure if I am doing the whole thing correctly. So here it is:
Ha
What I did: sudo -u jenkins ssh-keygen. It works so far