Load Spark data locally Incomplete HDFS URI

Question

I have experienced a problem with SBT loading in a local CSV file. Basically, I\'ve written a Spark program in Scala Eclipse which reads the following file:

Answer 1

Use:

val searches = sc.textFile("hdfs://host:port_no/data/searches")

Default

host: master
port_no: 9000

Answer 2

This should work:

sc.textFile("file:///data/searches")

from you error it seems like spark is loading Hadoop config, this can accure when you have a Hadoop conf file or a Hadoop environment variable set (like HADOOP_CONF_DIR)