Pyspark - How to filter out .gz files based on regex pattern in filename when reading into a pyspark dataframe

前端 未结 0 1134
南方客
南方客 2021-01-02 06:17

I have a folder structure as following: data/level1=x/level2=y/level3=z/

And in this folder, I have some files as following: filename_type_20201212.gz filename_type_2

相关标签:
回答
  • 消灭零回复
提交回复
热议问题