Using GPU for reinforcement learning with Keras

Question

I am using this code (please excuse its messiness) to run on my CPU. I have a custom RL environment that I have created myself and I am using DQN agent.

But when I ru