Why apache spark does not work with java 10? We get illegal reflective then java.lang.IllegalArgumentException

Question

Is there any technical reason why spark 2.3 does not work with java 1.10 (as of July 2018)?

Here is the output when I run SparkPi example using spark-submit

Answer 1

Primary technical reason is that Spark depends heavily on direct access to native memory with sun.misc.Unsafe, which has been made private in Java 9.

• https://issues.apache.org/jira/browse/SPARK-24421
• http://apache-spark-developers-list.1001551.n3.nabble.com/Java-9-td20875.html