Here is the list: This is a dataframe in pyspark | id| list1 |list 2 | +----------+--------------------+--------------------+ |