pyspark iterate through gcs files and write to hdfs : RDD or Dataframe?

后端 未结 0 1632
不思量自难忘°
不思量自难忘° 2021-01-30 23:45

Trying to iteratate through a bunch of gcloud stored files in cloud:

gs://bucket_1/files_abcd_20200922_1.csv.gz
gs://bucket_1/files_abcd_20200922_2.csv.gz
gs://bu         


        
相关标签:
回答
  • 消灭零回复
提交回复
热议问题