How to set up logging level for Spark application in IntelliJ IDEA?

前端 未结 6 2383
旧时难觅i
旧时难觅i 2021-02-20 04:25

I\'m working on a Scala project in IntelliJ that was created through SBT. The project has Spark as one of its dependencies. I\'m still in the development phase so everything is

6条回答
  •  夕颜
    夕颜 (楼主)
    2021-02-20 04:44

    If you are working on the local development with IDE, you can change the log level at run-time by:

    LogManager.getRootLogger.setLevel(Level.ALL)

    Ps: Put that line after the SparkContext/ SQLContext was created in your code.

提交回复
热议问题