I have created the spider to crawel the pages from internet for my requirement but after some point of time they have changed the authentication mechanism to SSO.
