Optimizing single-gpu multi-session tensorflow inference

Question

Using:

Tensorflow version 1.15 - C++ API
Driver Version: 440.33.01
CUDA Version: 10.2
GPU Device: NVIDIA GeForce RTX 2080 Ti

I’m attempting to ru