I deleted the exported zip file that was placed in my exported templates folder and of course it still shows in Visual Studio\'s \"Add New Project\" dialog. I expected that but
In my case with Visual Studio 19 on Windows 10 it was this folder:
%userprofile%\AppData\Roaming\Microsoft\VisualStudio[VS_VERSION]\ProjectTemplatesCache
I deleted the template folder and voila!