Spark performance issue on lots of window function and very large dataset

前端 未结 0 726
南笙
南笙 2021-02-11 10:26

I am generating around 30 window functions and run it against a pretty large dataset (1.5bil records) which is 14 days worth of data. If I run it against 1 day so roughly 100mio

相关标签:
回答
  • 消灭零回复
提交回复
热议问题