How to check the Spark version

后端 未结 15 1159
时光取名叫无心
时光取名叫无心 2020-12-29 17:29

as titled, how do I know which version of spark has been installed in the CentOS?

The current system has installed cdh5.1.0.

15条回答
  •  伪装坚强ぢ
    2020-12-29 18:30

    If you want to print the version programmatically use

     from pyspark.sql import SparkSession 
    
     spark = SparkSession.builder.master("local").getOrCreate() 
     print(spark.sparkContext.version)
    

提交回复
热议问题