Push a pure-python module to Dask workers

Question

Is there an easy way in Dask to push a pure-python module to the workers?

I have many workers in a cluster and I want to distribute a local module that I have on my cl

Answer 1

Yes, use the Client.upload_file method.

client.upload_file('myfile.py')

This method will distribute the file and, if the file ends in .py or .egg will also import and reload the module on each of the workers.