I am trying to consume the avro message from kafka and process them to the delta table in the append mode.
I am using pyspark version 3.0.1 and delta version 0.6.0 on goo