Timeout Exception in Apache-Spark during program Execution

后端 未结 5 2615
花落未央
花落未央 2021-02-19 16:51

I am running a Bash Script in MAC. This script calls a spark method written in Scala language for a large number of times. I am currently trying to call this spark method for

5条回答
  •  北恋
    北恋 (楼主)
    2021-02-19 17:26

    pls increase the executer memory so that OOM will go away else make chnage in code so that your RDD wont have big memory foot print.

    --executer-memory = 3G

提交回复
热议问题