Hadoop MapReduce provide nested directories as job input

前端 未结 5 1766
忘了有多久
忘了有多久 2021-02-04 01:08

I\'m working on a job that processes a nested directory structure, containing files on multiple levels:

one/
├── three/
│   └── four/
│       ├── baz.txt
│               


        
5条回答
  •  借酒劲吻你
    2021-02-04 01:59

    just use FileInputFormat.addInputPath("with file pattern"); i am writing my first hadoop prog for graph analysis where input is from diff dir in .gz format ... it worked for me !!!

提交回复
热议问题