Reading specific rows of large matrix data file

前端 未结 4 1015
粉色の甜心
粉色の甜心 2021-02-09 22:50

Suppose I have a gigantic m*n matrix X (that is too big to read into memory) and binary numeric vector V with length m. My objective is to

4条回答
  •  别那么骄傲
    2021-02-09 23:08

    A viable strategy is to import the CSV file into a database (R supports connections to most of them. Go with MonetDB if you're feeling bleeding edge and speed matters; SQLite or whatever is handy otherwise).

    Then you can specify the appropriate subset using SQL and read that into R.

提交回复
热议问题