Hadoop MapReduce: Clarification on number of reducers

后端 未结 2 1705
花落未央
花落未央 2021-02-03 10:43

In the MapReduce framework, one reducer is used for each key generated by the mapper.

So you would think that specifying the number of Reducers in Hadoop MapReduce would

2条回答
  •  深忆病人
    2021-02-03 11:09

    one reducer is used for each key generated by the mapper

    This comment is not correct. One call to the reduce() method is done for each key grouped by the grouping comparator. A reducer (task) is a process that handles zero or more calls to reduce(). The property to which you refer is talking about the number of reducer tasks.

提交回复
热议问题