Spark: increase number of partitions without causing a shuffle?

后端 未结 3 1506
夕颜
夕颜 2021-02-07 03:22

When decreasing the number of partitions one can use coalesce, which is great because it doesn\'t cause a shuffle and seems to work instantly (doesn\'t require an a

3条回答
  •  长情又很酷
    2021-02-07 03:38

    Watch this space

    https://issues.apache.org/jira/browse/SPARK-5997

    This kind of really simple obvious feature will eventually be implemented - I guess just after they finish all the unnecessary features in Datasets.

提交回复
热议问题