I have followed the instruction on the \"GMP Install Instruction for Windows Platform\". I could build a 32bit version of GMP which can be used for Visual Studio.
You might want to take a look at MPIR. It is a fork of GMP that natively supports Visual Studio.