Browser-based client-side scraping

后端 未结 4 681
失恋的感觉
失恋的感觉 2020-12-31 02:05

I wonder if its possible to scrape an external (cross-domain) page through the user\'s IP?

For a shopping comparison site, I need to scrape pages of an e-com site b

4条回答
  •  小鲜肉
    小鲜肉 (楼主)
    2020-12-31 02:29

    Have a look at http://import.io, they provide a couple of crawlers, connectors and extractors. I'm not pretty sure how they get around bans but they do somehow (we are using their system over a year now with no problems).

提交回复
热议问题