How to convert List to JavaRDD

Question

We know that in spark there is a method rdd.collect which converts RDD to a list.

List f= rdd.collect();
String[] array = f.toArray(new String[f.si         


        

Answer 1

You're looking for JavaSparkContext.parallelize(List) and similar. This is just like in the Scala API.

Answer 2

Adding to Sean Owen and others solutions

You can use JavaSparkContext#parallelizePairs for List ofTuple

List<Tuple2<Integer, Integer>> pairs = new ArrayList<>();
pairs.add(new Tuple2<>(0, 5));
pairs.add(new Tuple2<>(1, 3));

JavaSparkContext sc = new JavaSparkContext();

JavaPairRDD<Integer, Integer> rdd = sc.parallelizePairs(pairs);