The accepted answer to this question is a guide for getting IIS Express to work with webmatrix. I found this guide more useful when trying to get it to work with VS 2010.
I just followed steps 3 & 4 (running IIS Express as administrator) and had to temporarily disable my firewall to get it working.