What is the difference between an RDD partition and a slice?

后端 未结 1 1142
被撕碎了的回忆
被撕碎了的回忆 2021-02-07 02:35

The Spark Programming Guide mentions slices as a feature of RDDs (both parallel collections or Hadoop datasets.) (\"Spark will run one task for each slice of the cluster.\") B

相关标签:
1条回答
  • 2021-02-07 02:56

    They are the same thing. The documentation has been fixed for Spark 1.2 thanks to Matthew Farrellee. More details in the bug: https://issues.apache.org/jira/browse/SPARK-1701

    0 讨论(0)
提交回复
热议问题