Hadoop DistributedCache functionality in Spark

前端 未结 2 1118
南方客
南方客 2021-01-12 15:24

I am looking for a functionality similar to the distributed cache of Hadoop in Spark. I need a relatively small data file (with some index values) to be present in all nodes

2条回答
  •  北荒
    北荒 (楼主)
    2021-01-12 15:55

    Please have a look at SparkContext.addFile() method. Guess that is what you were looking for.

提交回复
热议问题