Dealing with large files in Haskell

前端 未结 3 2114
别跟我提以往
别跟我提以往 2021-02-14 09:33

I have a large file (4+ gigs) of, lets just say, 4 byte floats. I would like to treat it as List, in the sense that I would like to be able to use map, filter, foldl, etc. Howev

3条回答
  •  [愿得一人]
    2021-02-14 10:06

    You might use mmap to map the file to memory and then process it. There is a mmap module that promises to read and write mmaped files and can even work with lazily mapped chunks of files, but I haven't tried it.

    The interface for writing to the mapped file seems to be quite low level, so you'd have to build your own abstractions or work with Foreign.Ptr and the like.

提交回复
热议问题