Scapy saving 200 status urls with empty items in a file

前端 未结 0 1305
無奈伤痛
無奈伤痛 2021-02-20 02:14

I notice in scrapy log that some urls returned 200 status but contained no items. It seems to be the stability of the site as re-crawling these urls 1-2 times again yield items.

相关标签:
回答
  • 消灭零回复
提交回复
热议问题