Handling large dense matrices in python

前端 未结 6 1177
[愿得一人]
[愿得一人] 2021-02-04 21:33

Basically, what is the best way to go about storing and using dense matrices in python?

I have a project that generates similarity metrics between every item in an array

6条回答
  •  予麋鹿
    予麋鹿 (楼主)
    2021-02-04 21:56

    PyTables can handle tables of arbitrary size (Millions of columns!), through using memmap and some clever compression.

    Ostensibly, it provides SQL like performance, to python. It will, however, require significant code modifications.

    I'm not going to accept this answer until I've done a more thorough vetting, to ensure it can actually do what I want. Or someone provides a better solution.

提交回复
热议问题