Pyspark Error while instantiating 'org.apache.spark.sql.hive.HiveExternalCatalog':

Question

There are multiple threads citing the same problem, none of them posted a solution. Facing the same error when trying to save the data to hive using pyspark. However, in my case