LSTM sequence prediction overfits on one specific value only

Question

hello guys i am new in machine learning. I am implementing federated learning on with LSTM to predict the next label in a sequence. my sequence looks like t