I\'m trying to get the path to spark.worker.dir for the current sparkcontext.
spark.worker.dir
sparkcontext
If I explicitly set it as a config param, I can read
config param
If you want to see the configuration in data bricks use the below command
spark.sparkContext._conf.getAll()