Scrapy: How to stop requesting in case of 302?

前端 未结 0 1066
有刺的猬
有刺的猬 2020-12-24 00:01

I am using Scrapy 2.4 to crawl specific pages from a start_urls list. Each of those URLs has persumably 6 result pages, so I request them all.

In some cases however t

相关标签:
回答
  • 消灭零回复
提交回复
热议问题