How to pass a list of paths to spark.read.load?

Question

I can load multiple files at once by passing multiple paths to the load method, e.g.

spark.read
  .format(\"com.databricks.spark.avro\")
  .load         


        

Answer 1

load method support varargs type of argument, not the list type. So you have explicitly convert list to varargs adding : _* in load function.

spark.read.format("com.databricks.spark.avro").load(paths: _*)