as titled, how do I know which version of spark has been installed in the CentOS?
The current system has installed cdh5.1.0.
If you want to print the version programmatically use
from pyspark.sql import SparkSession spark = SparkSession.builder.master("local").getOrCreate() print(spark.sparkContext.version)