问题
I am using Scrapy with Luminati proxy to scrape thousands of Amazon pages, but I noticed my scraping bandwidth consumption is very high. I am scraping the whole page right now and I am just wondering if it is possible to remove/block images, css, js because I am just dealing with html code to make the scraping bandwidth as minimum as possible.
thank you for looking into my problem :)
来源:https://stackoverflow.com/questions/59541755/how-to-decrease-the-bandwidth-of-scraping-pages-via-scrapy