Pyspark : Weird behavior observed while doing upsert into Posgresql from pyspark

Question

I am trying to do upsert from pyspark to postgresql. pyspark script is being submitted by NiFi using executesparkinteractive processor. This is what I am trying -

1. F