I have trained different number of layers in CNN+LSTM encoder and decoder model with attention. The problem I am facing is very strange to me. The validation loss is fluctua