Merge list of lists in pySpark RDD

Question

I have lists of tuples that I want to combine into one list. I\'ve been able to process the data using lambdas and list comprehension to where I\'m close to being able to u

Answer 1

You can do,

test = test.flatMap(identity)

or

test = test.flatMap(lambda list: list)

Answer 2

Thanks to @mrsrinivas for providing the hint...

test = test.flatMap(lambda xs: [(x[0], x[1]) for x in xs])