OK I did some testing and on my side (check out my comment in the question) it seems that the npm audit fix breaks the dependencies and causes ng serve to yield on that error.
It seems to have to do with a dependency and I hope they'll fix it soon...