Scraping data from all asp.net pages with AJAX pagination implemented

Question

I want to scrap a webpage containing a list of user with addresses, email etc. webpage contain list of user with pagination i.e. page contains 10 users when I click on page 2 li

Answer 1

I would recommend branching out into Ruby and trying Capybara which is a sane way of using Selenium. It lets you do a visit of a page, then examine the actual DOM. You can click on everything, wait for events, etc. It uses a real browser.

visit "http://www.google.com" 
page.find("button[name=btnK]")