Spark multi-stage mapWithState Shuffle issue

后端 未结 0 1741
不思量自难忘°
不思量自难忘° 2021-02-08 06:28

We have a stateful multi-stage DStream application where each stage is mapped to a different Key. Beyond the first stage we are experiencing huge Shuffle read and write which co

相关标签:
回答
  • 消灭零回复
提交回复
热议问题