When fitting a model with a simple RNN layer, I am hitting a val_accuracy ceiling of exactly 37.62% every time. Why is this happening?

Question

Using the keras simpleRNN layer, I am hitting this wall. I have two other models, one only with fully connected Dense layers, and one using LSTM which work as expected, so I