How to download chunked data with Pythons urllib2

Question

I\'m trying to download a large file from a server with Python 2:

req = urllib2.Request(\"https://myserver/mylargefile.gz\")
rsp = urllib2.urlopen(req)
data          


        

Answer 1

If I'm not mistaken, the following worked for me - a while back:

data = ''
chunk = rsp.read()
while chunk:
    data += chunk
    chunk = rsp.read()

Each read reads one chunk - so keep on reading until nothing more's coming. Don't have documenation ready supporting this...yet.