Python - read 1000 lines from a file at a time

Question

I\'ve checked this, this and this.

The 3rd link seemed to have the answer yet it didn\'t do the job.

I can\'t have a solution where the whole file is brought

Answer 1

As @Ev.kounis said your while loop doesn't seem to work properly.

I would recommend to go for the yield function for chunk of data at a time like this:

def get_line():
    with open('your file') as file:
        for i in file:
            yield i

lines_required = 1000
gen = get_line()
chunk = [next(gen) for i in range(lines_required)]