Why apache spark does not work with java 10? We get illegal reflective then java.lang.IllegalArgumentException

Question

Is there any technical reason why spark 2.3 does not work with java 1.10 (as of July 2018)?

Here is the output when I run SparkPi example using spark-submit

Answer 1

Spark depends on the memory API's which has been changed in JDK 9 so it is not available starting JDK 9.

And that is the reason for this.

Please check the issue:

https://issues.apache.org/jira/browse/SPARK-24421