Spark SQL fails with java.lang.NoClassDefFoundError: org/codehaus/commons/compiler/UncheckedCompileException

Question

Running a Spark SQL (v2.1.0_2.11) program in Java immediately fails with the following exception, as soon as the first action is called on a dataframe:

java.lang         


        

Answer 1

I had the similar issues, when updated spark-2.2.1 to spark-2.3.0.

In my case, I had to fix commons-compiler and janino

Spark 2.3 solution:

    
        
        
            org.codehaus.janino
            commons-compiler
            3.0.8
        
        
            org.codehaus.janino
            janino
            3.0.8
        
    


    
        org.codehaus.janino
        commons-compiler
        3.0.8
    
    
        org.codehaus.janino
        janino
        3.0.8