My .bashrc has this:
enable-pyenv () { # Load pyenv automatically by adding # the following to your profile: export PATH=\"$HOME/.pyenv/bin:$PATH\"
Try pyenv deactivate, to manually deactivate the virtual env.
pyenv deactivate
Doc here: https://github.com/yyuu/pyenv-virtualenv