The python bindings do actually allow you to configure an upstream proxy. When creating a proxy using create_proxy, you can set the value of httpProxy to the IP address and port of the upstream proxy (see the params parameter on create_proxy for details).