Scraping data without having to explicitly define each field to be scraped

后端 未结 4 850
情深已故
情深已故 2021-02-04 15:06

I want to scrape a page of data (using the Python Scrapy library) without having to define each individual field on the page. Instead I want to dynamically generate fields using

4条回答
  •  遥遥无期
    2021-02-04 15:39

    I know that my answer is late, but for those who still need a dynamic items using Scrapy (current version is 1), I created a repository on Github including an example.

    Here you go

    https://github.com/WilliamKinaan/ScrapyDynamicItems

提交回复
热议问题