handling offset with large amount of data in httphook custom operator

Question

I\'m aware that this is an open question however I\'m not sure how to present my issue.

I\'m working with the Yellow Taxi Trip Data from NYC open data trying to build