Spark-HBase - GCP template (2/3) - Version issue of json4s?

前端 未结 1 1517
一向
一向 2021-01-20 02:50

I\'m trying to test the Spark-HBase connector in the GCP context and tried to follow 1, which asks to locally package the connector [2] using Maven (I tried Maven 3.6.3) for

1条回答
  •  礼貌的吻别
    2021-01-20 03:08

    Consider reading these related SO questions: 1 and 2.

    Under the hood the tutorial you followed, as well of one of the question indicated, use the Apache Spark - Apache HBase Connector provided by HortonWorks.

    The problem seems to be related with an incompatibility with the version of the json4s library: in both cases, it seems that using version 3.2.10 or 3.2.11 in the build process will solve the issue.

    Add following dependency in pom.xml (shc-core):

    
      org.json4s
      json4s-jackson_2.11
      3.2.11
    
    

    0 讨论(0)
提交回复
热议问题