How to flatten list inside RDD?

Question

Is it possible to flatten list inside RDD? For example convert:

 val xxx: org.apache.spark.rdd.RDD[List[Foo]]

to:

 val yyy:         


        

Answer 1

You just need to flatten it, but as there's no explicit 'flatten' method on RDD, you can do this:

rdd.flatMap(identity)