Read CSV file from Azure Blob storage in Rstudio Server with spark_read_csv()
问题 I have provisioned an Azure HDInsight cluster type ML Services (R Server), operating system Linux, version ML Services 9.3 on Spark 2.2 with Java 8 HDI 3.6. Within Rstudio Server I am trying to read in a csv file from my blob storage. Sys.setenv(SPARK_HOME="/usr/hdp/current/spark-client") Sys.setenv(YARN_CONF_DIR="/etc/hadoop/conf") Sys.setenv(HADOOP_CONF_DIR="/etc/hadoop/conf") Sys.setenv(SPARK_CONF_DIR="/etc/spark/conf") options(rsparkling.sparklingwater.version = "2.2.28") library(sparklyr