Spark SQL on ORC files doesn't return correct Schema (Column names)

后端 未结 5 863
甜味超标
甜味超标 2020-12-21 09:55

I have a directory containing ORC files. I am creating a DataFrame using the below code

var data = sqlContext.sql(\"SELECT * FROM orc.`/directory/containing/         


        
5条回答
  •  囚心锁ツ
    2020-12-21 10:18

    Setting

    sqlContext.setConf('spark.sql.hive.convertMetastoreOrc', 'false')
    

    fixes this.

提交回复
热议问题