Spark Out of memory issue : forEachPartition

后端 未结 0 643
感动是毒
感动是毒 2021-02-09 14:30

[executor tasks]

We are processing roughly 500 MB file of data in EMR.

I am performing following operation on the file.

1] read csv :

val df          


        
相关标签:
回答
  • 消灭零回复
提交回复
热议问题