How to VPN/Proxy connect in Python?

前端 未结 2 1996
鱼传尺愫
鱼传尺愫 2021-01-31 09:40

I\'m trying to scrape some pages that are on a website but to view the pages, I need to be connected to a VPN. My setup is as follows:

  • I am running python on a clo
2条回答
  •  春和景丽
    2021-01-31 10:05

    I see that https://www.privateinternetaccess.com/ has option to use SOCKS5 proxy. If you are using requests module for scraping you may use SOCKS5 like that:

    pip install -U requests[socks]
    

    and in the script:

    import requests
    proxies = {'http': 'socks5://user:pass@host:port',
               'https': 'socks5://user:pass@host:port'}
    
    resp = requests.get('http://example.com', proxies=proxies )
    

提交回复
热议问题