I've used ZipCodeDownload in the past, and it's got lat/long info as well as postal codes, cities, etc... It is a commercial product however. (note I do not, nor have I ever, worked for this company)
EDIT:
It seems unlikely that you will find a free service that provides unlimited requests per second. I don't know if you looked at this link, but the product starts at $30 USD, which, in my mind is quite affordable.