IE 7 & 8 both throw an error when users attempt to download a csv file over https.
Internet Explorer cannot download downloadPage.jsf. Internet Explor
I think you are on the right track with caching:
This knowledge base article may help you, Internet Explorer is unable to open Office documents from an SSL Web site
Mentioned in this Stack Overflow question: Cannot open xls file in IE