How to set up logging level for Spark application in IntelliJ IDEA?

前端 未结 6 2402
旧时难觅i
旧时难觅i 2021-02-20 04:25

I\'m working on a Scala project in IntelliJ that was created through SBT. The project has Spark as one of its dependencies. I\'m still in the development phase so everything is

6条回答
  •  一个人的身影
    2021-02-20 04:43

    Setting the log level on the SparkContext worked for me under Eclipse

    spark.sparkContext.setLogLevel("WARN")  
    

提交回复
热议问题