Read multiple wildcard file patterns for multiple days - pyspark

后端 未结 0 1416
名媛妹妹
名媛妹妹 2020-12-18 07:50

I have 60 days of files that I need to load and do some aggs. I can load 1 pattern for a given day like this

df = spark.read.csv("/data/id/date=20201217/         


        
相关标签:
回答
  • 消灭零回复
提交回复
热议问题