Database connection not working with upgraded Azure pricing tier

Question

I have a web app hosted at Azure (ASP.NET Core) and it makes calls to a SQL database hosted somewhere else (not on Azure).

If I use the Free Pricing Tier everything w