Hadoop MapReduce provide nested directories as job input

前端 未结 5 1779
忘了有多久
忘了有多久 2021-02-04 01:08

I\'m working on a job that processes a nested directory structure, containing files on multiple levels:

one/
├── three/
│   └── four/
│       ├── baz.txt
│               


        
5条回答
  •  爱一瞬间的悲伤
    2021-02-04 02:05

    Don't know if still relevant but at least in hadoop 2.4.0 you can set property mapreduce.input.fileinputformat.input.dir.recursive to true and it will solve your problem.

提交回复
热议问题