Hadoop gen1 vs Hadoop gen2

前端 未结 9 1232
南笙
南笙 2021-02-10 09:22

I am a bit confused about place of tasktracker in Hadoop-2.x.

Daemons in Hadoop-1.x are namenode, datanode, jobtracker, taskracker and secondaryna

9条回答
  •  梦毁少年i
    2021-02-10 10:07

    In YARN (the new execution framework in Hadoop 2), MapReduce doesn't exist in the way it did before.

    YARN is a more general purpose way to allocate resources on the cluster. ResourceManager, ApplicationMaster, and NodeManager now consist of the new YARN execution framework. The NodeManager is the daemon on every node, so I guess you could say that replaced the TaskTracker. But now it just gives processes instead of just map tasks and reduce tasks.

    MapReduce is still there, but it is now an "application" of YARN.

    Here is an introduction to YARN, which will go into much more depth: http://hortonworks.com/blog/introducing-apache-hadoop-yarn/

提交回复
热议问题