Should spark dynamic allocation be enabled for a Spark batch job reading from Kafka?

前端 未结 0 1887
广开言路
广开言路 2021-01-26 02:21

I have a Spark batch job that consumes data from a Kafka topic with 300 partitions.

Since the partition count is fixed, shall I set the executor count to 75 with 4 cores

相关标签:
回答
  • 消灭零回复
提交回复
热议问题