Why there is a mapreduce.jobtracker.address configuration on YARN?

后端 未结 2 1597
眼角桃花
眼角桃花 2021-01-16 00:33

YARN is the Hadoop second generation that not use the jobtracker daemon anymore, and substitute it with resource manager. But why, on mapred-site.xml hadoop 2 there is an ma

相关标签:
2条回答
  • 2021-01-16 00:50

    You are correct. In YARN, jobtracker no longer exists. So as part of client configuration you don't have to to specify the property mapreduce.jobtracker.address. In YARN, you should specify the property mapreduce.framework.name to yarn in the config file. Instead of setting up mapreduce.jotracker.address, you need to specify yarn.resourcemanager.address.

    0 讨论(0)
  • 2021-01-16 01:07

    setting yarn.resourcemanager.address is not mandatory:

    refer following link which explains migration from MR1 to MR2

    https://www.cloudera.com/documentation/enterprise/5-4-x/topics/cdh_ig_mapreduce_to_yarn_migrate.html

    0 讨论(0)
提交回复
热议问题