I am trying to recreate a RNN whose graph is fig. 8 in this paper by K. Yeo et al.
So far I have simply used layers as described in the Keras functional API: