So I started using Git together with this workflow to make a personal website (mostly for testing and to learn Git) and I am developing it locally on my laptop using Xampp.
I also have heard/read (but not yet tried) that git availability on shared hosts is resource-intensive and so the admins shy away from allowing...
But in case you do want to try...
http://joemaller.com/908/how-to-install-git-on-a-shared-host/#hosting