I run a pyspark cluster on AWS EMR and use Jupyter to the pyspark driver. Recently, the script failed. Jupiter fails to start a server. I install with conda install ju
conda install ju
I found that after the update to jupyter 5.7. I had to modify the config parameters. Change
echo "c.NotebookApp.ip = '*'" >> ~/.jupyter/jupyter_notebook_config.py
to
echo "c.NotebookApp.ip = '0.0.0.0'" >> ~/.jupyter/jupyter_notebook_config.py