How to connect master and slaves in Apache-Spark? (Standalone Mode)

后端 未结 3 635
旧巷少年郎
旧巷少年郎 2021-02-03 12:29

I\'m using Spark Standalone Mode tutorial page to install Spark in Standalone mode.

1- I have started a master by:

./sbin/start-master.sh
3条回答
  •  予麋鹿
    予麋鹿 (楼主)
    2021-02-03 13:07

    In my case, using spark 2.4.7 in standalone mode, I've created a passwordless ssh key using ssh-keygen, but still got asked for worker password when starting the cluster.

    What I did was follow the instructions here https://www.cyberciti.biz/faq/how-to-set-up-ssh-keys-on-linux-unix/

    This line solved the problem: ssh-copy-id -i $HOME/.ssh/id_rsa.pub user@server-ip

提交回复
热议问题