I use the FireFox plugin "HTMLTidy" to do this. When you are testing, you can point Firefox to your dev server (i.e. "http://localhost:52457/...") and it will work as if the site were live.
Also consider setting HTML errors to be raised as compile errors in VS and set your compatibility level/Doctype to XHTML 1.1 Strict to get them all. These settings are under Tools -> Options -> Text Editor -> HTML -> Validation