Why does my LSTM model works for any batch size OTHER THAN 1?

Question

I created the following LSTM model and then I tried to find the best batch size. Surprisingly the model works very good for batch sizes of 2, 4, 8, 16, 32. But when it comes to