I have a scrapy spider as below to crawl data.
class MySpider(BaseSpider): name = "spider" def __init(self): self._allowed_domains = [