How to write a table to hive from spark without using the warehouse connector in HDP 3.1

后端 未结 3 576
萌比男神i
萌比男神i 2021-01-07 10:55

when trying to use spark 2.3 on HDP 3.1 to write to a Hive table without the warehouse connector directly into hives schema using:

spark-shell --driver-memor         


        
3条回答
  •  悲哀的现实
    2021-01-07 11:10

    Inside Ambari simply disabling the option of creating transactional tables by default solves my problem.

    set to false twice (tez, llap)

    hive.strict.managed.tables = false
    

    and enable manually in each table property if desired (to use a transactional table).

提交回复
热议问题