hadoop writables NotSerializableException with Apache Spark API

Question

Spark Java application throws NotSerializableException on hadoop writables.

public final class myAPP {
  public static void main(String[] args) throws Exception          


        

Answer 1

use

sparkConf.set("spark.kryo.classesToRegister", "org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text")

or you can simply use

ctx.textFile(args[0]);

to load RDD