Setting spark classpaths on EC2: spark.driver.extraClassPath and spark.executor.extraClassPath

后端 未结 2 786
佛祖请我去吃肉
佛祖请我去吃肉 2021-02-20 12:25

Reducing size of application jar by providing spark- classPath for maven dependencies:

My cluster is having 3 ec2 instances on which hadoop and spark i

2条回答
  •  别跟我提以往
    2021-02-20 13:17

    You don't need to put all jars files .Just Put your application jar file . If you get again error than put all jar files which are needed .

    You have to put jars file by setJars() methods .

提交回复
热议问题