Difference between Spark dataset write

后端 未结 1 1093
星月不相逢
星月不相逢 2021-01-27 13:35

I\'m using Spark-Java.

I need to know If there is any diffrence (performance etc) between the following write to Hadoop methods:

ds.writ         


        
1条回答
  •  无人及你
    2021-01-27 14:15

    There is no difference

    orc(path) is simply a shortcut method for format("orc").save(path)

    Same applies for .json(path) and csv(path) with the default write(path) with no format being Parquet

    0 讨论(0)
提交回复
热议问题