PySpark java.io.IOException: No FileSystem for scheme: https

前端 未结 3 1252
情书的邮戳
情书的邮戳 2021-01-19 06:04

I am using local windows and trying to load the XML file with the following code on python, and i am having this error, do anyone knows how to resolve it,

3条回答
  •  遥遥无期
    2021-01-19 06:41

    I've commit a similar but slightly different error: forgot the "s3://" prefix to file path. After adding this prefix to form "s3://path/to/object" the following code works:

    my_data = spark.read.format("com.databricks.spark.csv")\
                   .option("header", "true")\
                   .option("inferSchema", "true")\
                   .option("delimiter", ",")\
                   .load("s3://path/to/object")
    

提交回复
热议问题