Missing hive-site when using spark-submit YARN cluster mode

Question

Using HDP 2.5.3 and I\'ve been trying to debug some YARN container classpath issues.

Since HDP includes both Spark 1.6 and 2.0.0, there have been some conflicting v

Answer 1

Found an issue with this

You create a org.apache.spark.sql.SQLContext before creating hive context the hive-site.xml is not picked properly when you create hive context.

Solution : Create the hive context before creating another SQL context.