Is there any way to read multiple parquet paths from s3 in parallel using spark?

后端 未结 0 1214
野的像风
野的像风 2021-02-15 13:04

My data is stored in s3 (parquet format) under different paths and I\'m using spark.read.parquet(pathes:_*) in order to read all the paths into one dataframe. Unfor

相关标签:
回答
  • 消灭零回复
提交回复
热议问题