native snappy library not available: this version of libhadoop was built without snappy support. while runnig query throgh hive

问题:

java.lang.RuntimeException: native snappy library not available: this version of libhadoop was built without snappy support. at org.apache.hadoop.io.compress.SnappyCodec.checkNativeCodeLoaded(SnappyCodec.java:65) at org.apache.hadoop.io.compress.SnappyCodec.getCompressorType(SnappyCodec.java:134) at org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:150)

i am using hadoop 2.7.3 version and hive 2.1.1 version

回答1:

I have the same problem with you and I solved it.

As the error hint, the problem is libhadoop.so library that is not support snappy when building. When hadoop invoke libhadoop.so's public static native boolean buildSupportsSnappy(), it will return false. So, we get the error.

The solution is following BUILDING.txt to build libhadoop.so supporting snappy.

Good luck.

文章来源: native snappy library not available: this version of libhadoop was built without snappy support. while runnig query throgh hive