How to convert List to JavaRDD

Question

We know that in spark there is a method rdd.collect which converts RDD to a list.

List f= rdd.collect();
String[] array = f.toArray(new String[f.si         


        

Answer 1

List fields = new ArrayList<>();
fields.add(DataTypes.createStructField("fieldx1", DataTypes.StringType, true));
fields.add(DataTypes.createStructField("fieldx2", DataTypes.StringType, true));
fields.add(DataTypes.createStructField("fieldx3", DataTypes.LongType, true));


List data = new ArrayList<>();
data.add(RowFactory.create("","",""));
Dataset rawDataSet = spark.createDataFrame(data, schema).toDF();