I wonder if its possible to scrape an external (cross-domain) page through the user\'s IP?
For a shopping comparison site, I need to scrape pages of an e-com site b
Have a look at http://import.io, they provide a couple of crawlers, connectors and extractors. I'm not pretty sure how they get around bans but they do somehow (we are using their system over a year now with no problems).