Why there is a mapreduce.jobtracker.address configuration on YARN?

后端 未结 2 1176
猫巷女王i
猫巷女王i 2021-01-16 00:15

YARN is the Hadoop second generation that not use the jobtracker daemon anymore, and substitute it with resource manager. But why, on mapred-site.xml hadoop 2 there is an ma

相关标签:
2条回答
  • 2021-01-16 00:41

    setting yarn.resourcemanager.address is not mandatory:

    refer following link which explains migration from MR1 to MR2

    https://www.cloudera.com/documentation/enterprise/5-4-x/topics/cdh_ig_mapreduce_to_yarn_migrate.html

    0 讨论(0)
  • 2021-01-16 00:58

    You are correct. In YARN, jobtracker no longer exists. So as part of client configuration you don't have to to specify the property mapreduce.jobtracker.address. In YARN, you should specify the property mapreduce.framework.name to yarn in the config file. Instead of setting up mapreduce.jotracker.address, you need to specify yarn.resourcemanager.address.

    0 讨论(0)
提交回复
热议问题