How to decompress the hadoop reduce output file end with snappy?

后端 未结 1 1457
谎友^
谎友^ 2021-02-19 16:03

Our hadoop cluster using snappy as default codec. Hadoop job reduce output file name is like part-r-00000.snappy. JSnappy fails to decompress the file bcz JSnappy r

相关标签:
1条回答
  • 2021-02-19 16:31

    Use "Hadoop fs -text" to read this file and pipe it to txt file. ex:

    hadoop fs -text part-r-00001.snappy > /tmp/mydatafile.txt

    0 讨论(0)
提交回复
热议问题