File count in an HDFS directory

前端 未结 6 1990
攒了一身酷
攒了一身酷 2021-01-31 10:36

In Java code, I want to connect to a directory in HDFS, learn the number of files in that directory, get their names and want to read them. I can already read the files but I co

6条回答
  •  深忆病人
    2021-01-31 10:57

    You can use the following to check file count in that particular directory

    hadoop fs -count /directoryPath/* | print $2 | wc -l

    count : counts the number of files, directories, and bytes under the path

    print $2 : To print second column from the output

    wc -l : To check the line count

提交回复
热议问题