I installed Vundle via the instructions given at this blog http://web.archive.org/web/20120731003342/http://www.charlietanksley.net/philtex/sane-vim-plugin-management
bu
Vundle is installed in
~/.vim/bundle/vundle
so this line
set rtp+=~/.vim/vundle.git/
should be
set rtp+=~/.vim/bundle/vundle
~/.vim/vundle.git/
is the path of a folder containing everything that makes a Git repository a Git repository. You can't really expect Vim to find usable scripts there.