Qt auto test changes only effective after “rebuild” not after “build”

Question

I added an auto test project to my C++ Qt project (compiling with MSVC 2019). But changes in the test source files do only take effect if I rebuild and run the test