I have to close and reopen VS Code for it to switch branches. Not sure why it is doing this, it is updated to latest version as well.