Keras Custom Loss Function Not Behaving As Expected

Question

This is the model

model = keras.Sequential(
    [
        Conv2D(64, 3, activation=\'relu\', padding=\'same\', input_shape=(96,96,3)),
        Conv2D(64, 3, activ