Spark UI on AWS EMR

Question

I am running a AWS EMR cluster with Spark (1.3.1) installed via the EMR console dropdown. Spark is current and processing data but I am trying to find which port has been assign

Answer 1

Glad to announce that this feature is finally available on AWS. You won't need to run any special commands (or to configure a SSH tunnel) :

By clicking on the link to the spark history server ui, you'll be able to see the old applications logs, or to access the running spark job's ui :

For more details: https://docs.aws.amazon.com/emr/latest/ManagementGuide/app-history-spark-UI.html

I hope it helps !