I set PYSPARK_PYTHON=python3.6. I also check both master and worker\'s python version and they both have python3.6 as runnable program. However whe
PYSPARK_PYTHON=python3.6
python3.6