In my case I had an old method of pruning tags causing the issue. I solved it by unsetting the original:
git config --global --unset remote.origin.fetch '\+refs/tags/\*:refs/tags/\*'
then adding this to prune deleted branches on the server:
git config --global fetch.pruneTags true