For some context: I created an Azure web app and deployed a react app to it. I then added my custom domain and that was working fine to display my website at {my-site}.com.