Redmine has all that out of the box in a generally very good quality.
However the Installation of Redmine is a different issue. Redmine has a lot of dependencies and many of those dependencies have multiple versions which are not compatible with each other. I was unable to install the most recent redmine manually so far.
What worked fine however was the redmine package provided by Debian Squeeze. It's an older version (1.0.1-2) but has everything you need. I know that openSUSE and Ubuntu also provide redmine packages. (both version 1.1.3, they weren't able to get an recent version installed either, huh?)