Nan losses using “Learning Rate Step Decay” Scheduler with Adam Optimizer in Keras?

Question

I have this very deep model:

def get_model2(mask_kind):

decay = 0.0

inp_1 = keras.Input(shape=(64, 101, 1), name="RST_inputs")
x = layers.Conv2D(256,