Running Multiple spiders in scrapy

前端 未结 4 1374
滥情空心
滥情空心 2021-01-05 04:27
  1. In scrapy for example if i had two URL\'s that contains different HTML. Now i want to write two individual spiders each for one and want to run both the spiders at

4条回答
  •  执笔经年
    2021-01-05 05:10

    You should use scrapyd to handle multiple crawler http://doc.scrapy.org/en/latest/topics/scrapyd.html

提交回复
热议问题