Hive Merge command is not working in Spark HiveContext

Question

I am running hive merge command using Spark HiveContext in 1.6.3 spark version, but it is failing with below error.

2017-09-11 18:30:33 Driver [INFO ] ParseDrive         


        

Answer 1

Spark doesn't support UPDATES or DELETES so exception is an expected behavior.

Answer 2

To use MERGE operation you will need to execute it through the HIVE JDBC since MERGE is not supported by Spark SQL as of this day.