How to setup ssh tunnel for ipython cluster (ipcluster)

Question

I would like to run an ipython cluster on a ssh-accessible server and on some other machines all of which can connect to each other via ssh. The network is not trusted.

I

Answer 1

Thank you for the copying precious instructions, now the link to the blog is broken! I was able to make it work by editing the corresponding items in the configuration files. First, create a profile :

ipython profile create --parallel --profile=myCluster

Then, edit ~/.ipython/profile_myCluster/ipcontroller_config.py in order to have:

c.HubFactory.control = 10203,10103
c.HubFactory.task = 10205,10105
c.HubFactory.mux = 10204,10104
c.HubFactory.regport = 10101
c.HubFactory.hb = 10102,10112

Now, if the ports are reachable, you just need to launch

ipcluster start --profile=myCluster

For other options, see http://ipython.org/ipython-doc/1/parallel/parallel_process.html#using-ipcluster-in-ssh-mode