Implementing different types of authentication mechanisms for crawling web pages using Scrapy

Question

I had written a scrapy spider for crawling list of URLs which I am passing as start_urls.In the following way.

class PageScraper(scrapy.Spider):
name = \'pagescra