How to store a large directed unweighted graph with billions of nodes and vertices

删除回忆录丶 提交于 2020-01-22 06:02:48

问题


The graph size is in the billions of nodes, and tens of billions of vertices.

It will store webpages urls, and links between webpages and it will be used for testing ranking algorithms.

Any language is fine but java is prefered.

Solutions i found so far:

  1. neo4j
  2. storing in sorted flat files

Yes, i have already read Best Way to Store/Access a Directed Graph.

Update

The data can be distributed on multiple computers and does not need to be fully in-memory.


回答1:


Depending on your implementation, another solution could be Terracotta. I think supports object graphs of this magnitude using a distributed virtual heap.

http://www.terracotta.org/web/display/docs/Concept+and+Architecture+Guide#ConceptandArchitectureGuide-VirtualHeap



来源:https://stackoverflow.com/questions/1526479/how-to-store-a-large-directed-unweighted-graph-with-billions-of-nodes-and-vertic

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!