If you are handling URL's via browse-url, you can also set it to Windows-specific function like this. Then the URL's will be handled by Windows (invoking your default browser).
browse-url-browser-function is a variable defined in `browse-url.el'.
Its value is browse-url-default-windows-browser