pyspark shuffle while reading and writing same parquet file

后端 未结 0 1924
故里飘歌
故里飘歌 2021-01-20 03:05

I have dumped some data into parquet format on s3 through pyspark(V2.4.4).

df.write.partitionBy("col_id").format("parquet").mode("app         


        
相关标签:
回答
  • 消灭零回复
提交回复
热议问题