I have dumped some data into parquet format on s3 through pyspark(V2.4.4).
df.write.partitionBy("col_id").format("parquet").mode("app