Value for HADOOP_CONF_DIR from Cluster

Question

I have setup a cluster(YARN) using Ambari with 3 VMs as hosts.

Where I can find the value for HADOOP_CONF_DIR ?

# Run on a YARN cluster
export HADOOP         


        

Answer 1

Install Hadoop as well. In my case I've installed it in /usr/local/hadoop

Setup Hadoop Environment Variables

export HADOOP_INSTALL=/usr/local/hadoop

Then set the conf directory

export HADOOP_CONF_DIR=$HADOOP_INSTALL/etc/hadoop

Answer 2

From /etc/spark/conf/spark-env.sh:

export HADOOP_CONF_DIR=${HADOOP_CONF_DIR:-/etc/hadoop/conf}