Error while using Hive context in spark : object hive is not a member of package org.apache.spark.sql

后端 未结 4 2275
忘掉有多难
忘掉有多难 2021-02-19 18:44

I am trying to construct a Hive Context ,which inherits from SQLContext.

val sqlContext = new org.apache.spark.sql.hive.HiveContext(sc)

I get t

4条回答
  •  温柔的废话
    2021-02-19 18:52

    Here's an example maven dependency

    
            org.apache.spark
            spark-hive_${scala.tools.version}
            ${spark.version}
    
    

    --- for those who need to know how to set the properties in POM, below is an example

    
            1.7
            1.7
            UTF-8
            2.10
            2.10.4
            1.5.0
    
    

提交回复
热议问题