Spark SQL “No input paths specified in jobs” when create DataFrame based on JSON file

Question

I am a beginner in Spark and I am trying to create a DataFrame based on the content of JSON file using PySpark by following the guide: http://spark.apache.org/docs/1.6.1/sql-pro

Answer 1

You must specify the file system protocol:

• hdfs Hadoop File System (used by default)
• file local file system
• s3a / s3n AWS S3
• swift

But also, the path must exist where the Spark driver and worker(s) are executed.