I am a bit confused with the number of parameters that Keras/Tensorflow 2.1.0 reports for different RNN layers. For SimpleRNN element the following code works as expected: