Spark SQL fails with java.lang.NoClassDefFoundError: org/codehaus/commons/compiler/UncheckedCompileException

Question

Running a Spark SQL (v2.1.0_2.11) program in Java immediately fails with the following exception, as soon as the first action is called on a dataframe:

java.lang         


        

Answer 1

The culprit is the library commons-compiler. Here is the conflict:

To work around this, add the following to your pom.xml:

    
        
            org.codehaus.janino
            commons-compiler
            2.7.8