How can I read large text files in Python, line by line, without loading it into memory?

Question

I need to read a large file, line by line. Lets say that file has more than 5GB and I need to read each line, but obviously I do not want to use readlines() bec

Answer 1

Please try this:

with open('filename','r',buffering=100000) as f:
    for line in f:
        print line