Why is this simple Spark program not utlizing multiple cores?

Question

So, I\'m running this simple program on a 16 core multicore system. I run it by issuing the following.

spark-submit --master local[*] pi.py

And

Answer 1

I tried the method mentioned by @Svend, but still does not work.

The following works for me:

Do NOT use the local url, for example:

sc = SparkContext("local", "Test App").

Use the master URL like this:

sc = SparkContext("spark://your_spark_master_url:port", "Test App")