I experienced some weird behaviour with a spark dataframe. It is Spark Version version 2.4.0 (before i had thought 2.6 thus edited)
UPDATE:
I read in data from
