Use a method inside a UDF function Spark Scala

Question

I want to use a method located in another class inside a user-designed function but it\'s not working.

I have a method:

 def traitementDataFrameEleve(sc         


        

Answer 1

It is not allowed to access:

• distributed data structures (like Dataset or RDD).
• SparkConext / SparkSession

from Spark task (transformation, udf application). This is why you get a NPE.