What is the fastest way to read 10 GB file from the disk?

后端 未结 13 3729
你的背包
你的背包 2021-02-20 01:19

We need to read and count different types of messages/run some statistics on a 10 GB text file, e.g a FIX engine log. We use Linux, 32-bit, 4 CPUs, Intel, coding in Perl but the

13条回答
  •  礼貌的吻别
    2021-02-20 01:55

    Have you thought of streaming the file and filtering out to a secondary file any interesting results? (Repeat until you have a manageble size file).

提交回复
热议问题