Visual Studio forces me to re-add references to local projects to use current state

Question

So i got some projects, a windows application, some class libraries and some unit test projects. The windows application and the test project reference the class libraries as pr