I just installed a brand new copy of mingw (32 bit) downloading it from the official project page from Sourceforge. I installed everything in the package, all compilers and
gmpxx.h header file is included in the libgmp-dev package
gmpxx.h
libgmp-dev
You can install it on Ubuntu based machines with this command:
$ sudo apt-get install libgmp-dev