问题
I am running a Spark Streaming application with batch duration of 1 minute, and I have dynamic allocation enabled with executorIdleRunTime equal to 5 seconds. I can see in event timeline that they about 4000 many executors allocated and removed but in executors I always see 102 number of executors.What can be the reason of that.Rest API gives the same data but executor is there is different.
I have attached the respective snapshots for better understanding of the question.
来源:https://stackoverflow.com/questions/45012864/why-number-of-executors-shown-in-spark-web-ui-and-rest-ui-is-constant-always-w