I am trying to run spark structured streaming job that reads CSV files from local and load to HDFS in parquet format.
Below is sample of code:
pyspark2