Slave nodes not in Yarn ResourceManager

Question

I\'ve set up a 3 node Apache Hadoop cluster. On master node, I can see

[hadoop-conf]$ jps
16856 DataNode
17051 SecondaryNameNode
16701 NameNode
21601 Resour         


        

Answer 1

Problem solved. Some configuration should be done in yarn-site.xml to let the nodemanager know where is the resource manager. Specifically, I added this property into yarn-site.xml:

  
    yarn.resourcemanager.hostname
    master
  

Reason: the default value in yarn-default.xml is 0.0.0.0, and many properties use this hostname to contact resource manager, such as

    yarn.resourcemanager.address
    ${yarn.resourcemanager.hostname}:8032

Answer credits: https://stackoverflow.com/a/22125279/3209177