I\'m working on a Scala project in IntelliJ that was created through SBT. The project has Spark as one of its dependencies. I\'m still in the development phase so everything is
For shutting down/setting log level programmatically in spark 2.0+
Logger.getLogger("org.apache.spark").setLevel(Level.OFF);