I am trying to use the EpisodicReplayBuffer in Tensorflow TF-Agents with a simple custom TF-agents environment. I am trying to use it with the DQNAgent and a q_rnn_network.
