How do i store webscraped data efficiently in a database?

后端 未结 0 1097
遥遥无期
遥遥无期 2020-11-30 00:50

I am currently writing a web crawler using Scrapy on Python. I will be scraping about 4,000,000 pages every day, resulting in about 10 values (floats) scraped per page, per

相关标签:
回答
  • 消灭零回复
提交回复
热议问题