What is shuffle read & shuffle write in Apache Spark

后端 未结 2 1692
心在旅途
心在旅途 2021-02-03 23:07

In below screenshot of Spark admin running on port 8080 :

\"enter

The \"Shuffle R

2条回答
  •  清歌不尽
    2021-02-03 23:24

    I believe you have to run your application in cluster/distributed mode to see any Shuffle read or write values. Typically "shuffle" are triggered by a subset of Spark actions (e.g., groupBy, join, etc)

提交回复
热议问题