Tensorflow Keras CPU vs GPU – Loss much worse?

Question

I am running the Keras example "OCR model for reading Captchas" https://keras.io/examples/vision/captcha_ocr/ with and without GPU on the same system.