HTTPS proxies not working with Python's requests module

Question

I\'m pretty new to Python and I\'ve been using their requests module as a substitute for PHP\'s cURL library. My code is as follows

import requests
import jso         


        

Answer 1

Edit June 2019: This reply is not relevant anymore. Issue(s) are fixed.

Edit 2: "note that even for https proxy, the proxy address' scheme is http, it's because the client and proxy server initiate the tunnelling(the CONNECT method) in plain http. However, that's may not be true 3 years ago." - From the comments

HTTPS is 'bugged' in requests. I don't know the specifics but you can find a few other topics on this website concerning the issue. Also a Github issue is still active here. I'm suspecting you're having the problems mentioned there. If I am totally wrong, someone correct me.

To verify:

$~ curl --proxy https://27.254.52.99:8080 icanhazip.com
27.254.52.99

Works, but then in Python:

>>> proxies={'https': 'https://27.254.52.99:8080'}
>>> r = requests.get('http://icanhazip.com', headers={'User-Agent': 'Bla'}, proxies=proxies)
print r.content
<my ipv6 address comes up>

As you can see, my address comes up which means the proxy did nothing.

I don't understand why you are receiving a stacktrace. Maybe because your API is on HTTPS as well (?). Or maybe your API is just... down.

Anyway, the proxy does work in requests if its over HTTP.

>>> proxies={'http': 'http://27.254.52.99:8080'}
>>> r = requests.head('http://icanhazip.com', headers={'User-Agent': 'Bla'}, proxies=proxies)
print r.content
27.254.52.99