HTTP head request in scrapy sitemap spider

后端 未结 0 1969
猫巷女王i
猫巷女王i 2021-01-29 18:24

I am currently using a scrapy sitemap spider to parse a website. I plan to run this spider periodically. The webpages of this website change quite infrequently. Hence I would li

相关标签:
回答
  • 消灭零回复
提交回复
热议问题