Scrapy referer not returnin readable url

后端 未结 0 1589
眼角桃花
眼角桃花 2021-02-01 21:22

While scraping a website, I want to get the referer that is pointing to 404s.

def parse_item(self, response):

    if response.status == 404:
        Do something         


        
相关标签:
回答
  • 消灭零回复
提交回复
热议问题