Stop Scrapy crawler from external domains

后端 未结 0 678
忘了有多久
忘了有多久 2020-12-30 19:16

I am new to scrapy and trying to run a crawler on a few websites where my allowed domain and start url looks like this

 allowed_domains = [\'www.siemens.com\'         


        
相关标签:
回答
  • 消灭零回复
提交回复
热议问题