Out Of Memory Error for writing big CSV file from local into HDFS by spark streaming job

后端 未结 0 1664
礼貌的吻别
礼貌的吻别 2020-12-28 11:59

I am trying to write CSV file from local to HDFS in parquet format by spark streaming job. Size of file is 4GB. i am getting below error: [Stage 3:>

相关标签:
回答
  • 消灭零回复
提交回复
热议问题