How can one list all csv files in an HDFS location within the Spark Scala shell?

Question

The purpose of this is in order to manipulate and save a copy of each data file in a second location in HDFS. I will be using

RddName.coalesce(1).saveAsTex         


        

Answer 1

sc.wholeTextFiles(path) should help. It gives an rdd of (filepath, filecontent).