Low GPU usage by Keras / Tensorflow?

Question

I\'m using keras with tensorflow backend on a computer with a nvidia Tesla K20c GPU. (CUDA 8)

I\'m tranining a relatively simple Convolutional Neural Network, during tra

Answer 1

Measuring GPU performance and utilization is not as straightforward as CPU or Memory. GPU is an extreme parallel processing unit and there are many factors. The GPU utilization number shown by nvidia-smi means what percentage of the time at least one gpu multiprocessing group was active. If this number is 0, it is a sign that none of your GPU is being utilized but if this number is 100 does not mean that the GPU is being used at its full potential.

These two articles have lots of interesting information on this topic: https://www.imgtec.com/blog/a-quick-guide-to-writing-opencl-kernels-for-rogue/ https://www.imgtec.com/blog/measuring-gpu-compute-performance/