Why do my tests fail with `rush install`, but run after doing `rush update --recheck/full`?

Question

We started using Rush earlier this Summer and recently we started getting problems with non-reproducible test failures that varied depending on machine. Tests would pass on one