I was successful following the directions here:
http://www.krizka.net/2010/12/30/setting-up-a-public-git-repository-with-godaddy-shared-hosting/
The keys (for me) were
- Getting the precompiled binary for CentOS (from a link in post above)
- Setting the "uploadpack" and "receivepack". This is step 1 in the section "Letting local git know about remote git" near the end of the post.