Is there some directive I could use in my HTML to tell the browser not to ask for the favicon?
Add this line.
This assigns an empty data URL to the favicon’s element which specifies the location of the external resource. This trick stops the user’s browser from sending an automatic HTTP request for the favicon.
This has some more details