Hadoop: Number of reducer is not equal to what I have set in program

前端 未结 1 1518
Happy的楠姐
Happy的楠姐 2021-01-22 12:15

I have set mapred.tasktracker.reduce.tasks.maximum to 10 in mapred-site.xml, and I also write jobConf.setNumReduceTasks(5) in my job.

Everythin

1条回答
  •  天涯浪人
    2021-01-22 12:30

    Running it in eclipse seems to use the local job runner. It only supports 0 or 1 reducers. If you try to set it to use more than one reducer, it ignores it and just uses one anyway.

    0 讨论(0)
提交回复
热议问题