Bluemix spark-submit — How to secure credentials needed by my Scala jar

后端 未结 2 522
醉梦人生
醉梦人生 2021-01-14 11:37

I have a Spark application that I am submitting to the Bluemix Spark Cluster. It reads from a DASHDB database and writes the results to Cloudant. The code accesses the DAS

相关标签:
2条回答
  • 2021-01-14 11:52

    I think the jdbc driver will always need username and password to connect to database so that is out of question as you are in multi-tenant enviornment on bluemix.

    Now about spark-submit.sh to read the arguments securely, that option is not available yet.

    Thanks, Charles.

    0 讨论(0)
  • 2021-01-14 11:59

    Based on the answer here, my preference would be to pass a properties file that has the credentials. Other tenants will not be able to read the properties file, but you will be able to read if from your spark application, e.g. as a dataframe spfrom which you can access the parameters.

    0 讨论(0)
提交回复
热议问题