what is the best way to add multiple Start URLs in Scrapy Crawlspider with different allowed domains?

前端 未结 0 991
说谎
说谎 2021-02-15 23:26

currently, I\'m using the below code to add multiple start URLs (50K).

start_urls=[]
allowed_domains=[]    
df=pd.read_excel("xyz.xlsx")    
for url in          


        
相关标签:
回答
  • 消灭零回复
提交回复
热议问题