Google's Chrome is using 4 windows mechanisms to achieve this:
A restricted token
The Windows job object
The Windows desktop object
Windows Vista only: The integrity levels
Have a look at:
https://sites.google.com/a/chromium.org/dev/developers/design-documents/sandbox
They have a detailed description of what they're doing.
