Is there some directive I could use in my HTML to tell the browser not to ask for the favicon?
You could try pointing the at a data URL. As commented below, IE will not like this, though.
Example (from 11011.net):
Edited to reflect Pekka's concern regarding IE.