Block direct IP access with NGINX with site behind Cloudflare

Question

I\'m trying to block direct IP access with NGINX.

I added the following block

server {
  listen      80 default_server;
  server_name "";
  r