The specifications (plural, since there are versions 87a and 89a) of the GIF graphics format are easy to find in the internet (for those who don\'t want to google:
Gifsicle is pushing Gif to its limits. I've got an image that exposes decoding bug in OS X.
I was searching for the same thing and came across this page:
http://code.google.com/p/imagetestsuite/
It contains test suites for PNG/GIF/JPEG/TIFF created so that they try to achieve maximum amount of code coverage with the least amount of images based on the open source decoder code-bases. The idea seems good, but I have not yet had time to check out the actual images.
I found this question and didn't find anything comprehensive that I could use. So I wrote PyGIF and made it generate a test suite of GIF images.
I maintain a collection of test images for several file formats here:
https://github.com/drewnoakes/metadata-extractor-images
It contains those from the ImageTestSuite mentioned in Leo's answer, along with others from various contributors over the years.