In Hadoop where does the framework save the output of the Map task in a normal Map-Reduce Application?

后端 未结 3 1856
爱一瞬间的悲伤
爱一瞬间的悲伤 2021-02-06 08:38

I am trying to find out where does the output of a Map task is saved to disk before it can be used by a Reduce task.

Note: - version used is Hadoop 0.20

3条回答
  •  北海茫月
    2021-02-06 09:19

    Map reduce framework will store intermediate output into local disk rather than HDFS as this would cause unnecessarily replication of files.

提交回复
热议问题