I've found the "Show missing files for VS 2019" Visual Studio extension. It will show the list both missing and not referenced from project files in the "Error list" window after the build.
For the older Visual Studio use "Show missing files for VS 2013-2017" extension.