Cannot connect to HBase using Java

Question

I am trying to use Java to connect HBase. There are only 1 node, which is my own machine. It seems that I cannot connect successfully.

Here is my Java code:

<         


        

Answer 1

Provide the full path to this jar like this ->

sc.addJar("htrace-core.jar");

Answer 2

Caused by:

java.lang.NoClassDefFoundError: org/cloudera/htrace/Trace

Based on this line in error stack trace including htrace-core.jar might help.

Answer 3

I got this error when connecting to Hbase from java library without spark as well. I have added below classpath but it didn't work

export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:/usr/lib/hbase/*

But then i added hbase-solr path as htrace jar is present inside this path

export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:/usr/lib/hbase/*:/usr/lib/hbase-solr/lib/*

Hope this should work for you.

Answer 4

For Spark-HBase integration, the best way is to add HBase libraries to Spark Classpath. This can be done using the 'compute-classpath.sh' script in $SPARK_HOME/bin folder. Spark invokes 'compute-classpath.sh' and picks up the required hbase jars hence.

export CLASSPATH=$CLASSPATH:<path/to/HBase/lib/*>

eg: export CLASSPATH=$CLASSPATH:/opt/cloudera/parcels/CDH/lib/hbase/lib/*

After this, restart Spark.

There you go :)