NGINX reverse_proxy pass 404 from proxy to client

Question

I have a NGINX reverse proxy running, for several static sites (in docker containers); everything is working as it should be.

However if I navigate to a non-existing link