dramatic model performance increase between tf 2.1.0 and 2.3.0

Question

I get much better accuracy with the same, simple model architecture with tf 2.3.0 than with tf 2.1.0. Unfortunately, I can\'t upgrade just yet.

Model: