“Combiner" Class in a mapreduce job
问题 A Combiner runs after the Mapper and before the Reducer,it will receive as input all data emitted by the Mapper instances on a given node. then emits output to the Reducers. And also,If a reduce function is both commutative and associative , then it can be used as a Combiner. My Question is what does the phrase " commutative and associative " mean in this situation? 回答1: Assume you have a list of numbers, 1 2 3 4 5 6. Associative here means you can take your operation and apply it to any