What is the fastest way to read several lines of data from a large file
问题 My application needs to read like thousands of lines from a large csv file around 300GB with billion lines, each line contains several numbers. The data are like these: 1, 34, 56, 67, 678, 23462, ... 2, 3, 6, 8, 34, 5 23,547, 648, 34657 ... ... ... I tried fget reading file line by line in c, but it took really really really long, even with wc -l in linux, just to read all of the line, it took quite a while. I also tried to write all data to sqlite3 database based on the logics of the