Why is a CloudFront distribution with an ALB custom origin slower than the ALB without CloudFront?

Question

I have created an CloudFront distribution, with an ALB as custom origin. Caching is enabled with a minimum and default TTL of one day (in seconds of course).

After many t