Train and inference in parallel on GPU in Pytorch

Question

I have an RL agent which I\'d like to both train and do inference at the same time using my gpu. Hiowever using cuda with torch.multiprocessing doesn\'t seem to work well, and g