How to calculate the executors, cores and memory based on a given input file size in spark?

前端 未结 0 339
春和景丽
春和景丽 2021-01-21 14:47

Lets say I have 5 GB Input File and I have Cluster Setup of 3 Data Nodes with each 25 cores (Total - 75 cores) and 72GB memory (Total - 216GB Memory).

  1. How to ca

相关标签:
回答
  • 消灭零回复
提交回复
热议问题