MPI + GPU : how to mix the two techniques

Question

My program is well-suited for MPI. Each CPU does its own, specific (sophisticated) job, produces a single double, and then I use an MPI_Reduce to mult