When I run pyspark in hadoop yarn:
HADOOP_CONF_DIR=/usr/local/hadoop/etc/hadoop/ pyspark --master yarn --deploy-mode client
It gave me this:
