Reuse a cached Spark RDD

前端 未结 1 627
余生分开走
余生分开走 2021-01-21 13:53

Is there a possibility in Spark to re-use a cached RDD in another application (or in another run of the same application)?

JavaRDD toCache =          


        
相关标签:
1条回答
  • 2021-01-21 14:22

    No, Spark RDD cannot be used in other application or in another run.

    You can connect Spark with for example Hazelcast or Apache Ignite to save RDDs in memory. Other application will have possibility to read data saved in first application

    0 讨论(0)
提交回复
热议问题