Hadoop MapReduce provide nested directories as job input

前端 未结 5 1764
忘了有多久
忘了有多久 2021-02-04 01:08

I\'m working on a job that processes a nested directory structure, containing files on multiple levels:

one/
├── three/
│   └── four/
│       ├── baz.txt
│               


        
5条回答
  •  抹茶落季
    2021-02-04 02:05

    import org.apache.hadoop.mapreduce.lib.input.FileInputFormat;

    FileInputFormat.setInputDirRecursive(job, true);

    No thanks, just call me LeiFeng!

提交回复
热议问题