I have setup a cluster(YARN) using Ambari with 3 VMs as hosts.
Where I can find the value for HADOOP_CONF_DIR ?
# Run on a YARN cluster export HADOOP
From /etc/spark/conf/spark-env.sh:
/etc/spark/conf/spark-env.sh
export HADOOP_CONF_DIR=${HADOOP_CONF_DIR:-/etc/hadoop/conf}