Tensorflow distributed learning (multi_gpu_model): When to use cpu_merge vs cpu_relocation vs neither?

Question

When performing distributed learning on multiple GPUs using Tensorflow 2.0, I use the multi_gpu_model() function. There are two options in this method, cpu_merge an