Microsoft suggests to replace the new jquery.validate.js from mvc4 with the old jquery.validate.js from the MVC3 project template. This works, but the funny thing is, the bug is not in MVC4, it was in MVC3.
We use the way which was described by Francesco, see the accepted answer.