Spark ExecutorLostFailure

后端 未结 6 1841
悲&欢浪女
悲&欢浪女 2021-02-04 18:02

I\'m trying to run spark 1.5 on mesos in cluster mode. I\'m able to launch the dispatcher and to run the spark-submit. But when I do so, the spark driver fails with the followin

6条回答
  •  遥遥无期
    2021-02-04 18:40

    Setting the parallelism number helps. Try increase the parallelism in your cluster using the following parameter:

    --conf "spark.default.parallelism=100" 
    

提交回复
热议问题