Running Tensorflow and an external MPI APPs together through Python

Question

I want to run Tensorflow (TF) and a few MPI apps through Python. Where the MPI apps will run on demand. Furthermore, I want to run them on several nodes as on the schema at the