Spark DataFrame groupBy and sort in the descending order (pyspark)

后端 未结 5 1135
我在风中等你
我在风中等你 2021-01-30 07:46

I\'m using pyspark(Python 2.7.9/Spark 1.3.1) and have a dataframe GroupObject which I need to filter & sort in the descending order. Trying to achieve it via this piece of c

5条回答
  •  执念已碎
    2021-01-30 08:47

    you can use groupBy and orderBy as follows also

    dataFrameWay = df.groupBy("firstName").count().withColumnRenamed("count","distinct_name").sort(desc("count"))
    

提交回复
热议问题