Spark fails to start in local mode when disconnected [Possible bug in handling IPv6 in Spark??]

后端 未结 6 2018
轻奢々
轻奢々 2021-02-05 16:53

The problem is the same as described here Error when starting spark-shell local on Mac

... but I have failed to find a solution. I also used to get the malformed URI err

6条回答
  •  天涯浪人
    2021-02-05 17:37

    OK, I seem to be able to get around it by passing configuration directly --conf spark.driver.host=localhost

    So I run:

    ./bin/spark-shell --conf spark.driver.host=localhost
    

    Still if there is a better solution, please let me know.


    [UPDATE]

    Jacek Laskowski confirmed this is probably the only available solution for now.

提交回复
热议问题