I would like to run Git 1.6.x for Windows from a USB memory stick.
There is a Windows version of Git available at: http://code.google.com/p/msysgit/
Installing a
You could use the portable version from http://code.google.com/p/msysgit/