java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Windows.createFileWithMode0(Ljava/lang/String;JJJI)Ljava/io/FileDescriptor

后端 未结 3 2006
眼角桃花
眼角桃花 2020-12-22 03:35

I have a Spark project that used to work lately .

the project gets a CSV , and add two fields to it then it outputs with saveasTextfile() the content of

相关标签:
3条回答
  • 2020-12-22 03:43

    I was getting similar error, realized I had not created the environment variable HADOOP_HOME and Path variable was not updated with HADOOP_HOME\bin

    0 讨论(0)
  • 2020-12-22 03:51

    I had the same stack trace appear for me, but A.HADDAD's solution didn't work. I solved it by updating my hadoop version (which was 2.6.0) to 2.7.1, as it was closer the hadoop version indicated by my spark instalation (spark-2.3.2-bin-hadoop2.7).

    0 讨论(0)
  • 2020-12-22 04:02

    I Solved my question :

    After that worked for me lately i have put (to run another spark project) in the hadoop home hadoop.dll along side to winutils.exe. so i removed hadoop.dlland now everything is fine

    0 讨论(0)
提交回复
热议问题