Why does Spark crossJoin take so long for a tiny dataframe?

后端 未结 0 696
孤独总比滥情好
孤独总比滥情好 2020-12-06 15:25

I\'m trying to do the following crossJoin on two dataframes with 5 rows each, but Spark spawns 40000 tasks on my machine and it took 30 seconds to achieve the task. Any idea

相关标签:
回答
  • 消灭零回复
提交回复
热议问题