SPARK/SQL:spark can't resolve symbol toDF

前端 未结 2 576
旧时难觅i
旧时难觅i 2021-02-19 09:56

In my project, my external library is spark-assembly-1.3.1-hadoop2.6.0, if I press \'.\', the IDE inform me toDF(), but it inform me that can\'t resolv

2条回答
  •  悲&欢浪女
    2021-02-19 10:16

    This is a very late response to the question but just for the sake of people who are still looking for the answer:

    Try the same command on Spark 1.6 it will work.

    I was facing the same issue and searched in google and didn't get solution and then I upgraded Spark from 1.5 to 1.6 and it worked.

    If you don't know your Spark version:

    spark-submit --version (from command prompt)
    sc.version (from Scala Shell)
    

提交回复
热议问题