How to decompress the hadoop reduce output file end with snappy?

后端 未结 1 1449
谎友^
谎友^ 2021-02-19 16:03

Our hadoop cluster using snappy as default codec. Hadoop job reduce output file name is like part-r-00000.snappy. JSnappy fails to decompress the file bcz JSnappy r

1条回答
  •  陌清茗
    陌清茗 (楼主)
    2021-02-19 16:31

    Use "Hadoop fs -text" to read this file and pipe it to txt file. ex:

    hadoop fs -text part-r-00001.snappy > /tmp/mydatafile.txt

    0 讨论(0)
提交回复
热议问题