C# library similar to HtmlUnit

Question

I need to write standalone application which will \"browse\" external resource. Is there lib in C# which automatically handles cookies and supports JavaScript (through JS is

Answer 1

http://msdn.microsoft.com/en-us/library/system.windows.forms.webbrowser.aspx Try you WebBrowser class and work with DOM there

Answer 2

Look at Data Extracting SDK, which allows to post data via HtmlProcessor class. Also you can add your work item here if it is missed in the library.

Answer 3

Selenium, it uses the actual browsers, but is a cross browser platform. Depends on wether or not you can have an actual browser running - it works by injecting javascript via a proxy into the browser. http://seleniumhq.org/support/

Answer 4

The HtmlAgilityPack is specifically for parsing HTML. You can use the WebRequest class in the .NET Framework to handle communication and cookies.

See my blog entry on Web scraping in .NET. This won't answer all your questions, but will get you part of the way there.

Answer 5

If you're interested in writing your own version of htmlunit for C#, the IKVM project may be of help. http://www.ikvm.net/