Deciding the shuffle partition size and number of partitions in spark

后端 未结 0 443
星月不相逢
星月不相逢 2020-11-28 06:35

Can any of you tell how the below formula works in terms of shuttle partition file size and number of shuffle partitions ?

100 cores

150 shuffle partitions

相关标签:
回答
  • 消灭零回复
提交回复
热议问题