I refactored a project from using test suites to using JUnit Category annotations. I noticed a quite remarkable performance penalty when using categories (factor 4 times slower)