Visual Studio docker skipping project because not found, then restores and eventually builds but is slow

Question

I am trying to get to the bottom of a slow (30 seconds for vanilla default worker service) docker build process which I referenced one project from, I have the following doc