Diagnostics for CPU to GPU memory overhead delay?

Question

I am doing lots of Fourier Transforms of large datasets using tensorflow-gpu.

On the Windows 10 task manager, I see that the GPU "cuda" engine