I have a Spark batch job that consumes data from a Kafka topic with 300 partitions.
Since the partition count is fixed, shall I set the executor count to 75 with 4 cores