Nginx proxy_pass return 504 error directly

Question

For this proxy_pass, sometimes it works well, sometimes it returns 504 immediately. It seems like not stable. Someone could help me? Many thanks.

Nginx Config:

<