my hdp v2.6.4 is configured with default spark 1.6 client and a history server. I am able to run spark-submit from v2.4 client in yarn mode. while the job is still running i can