I always omit it for two reasons: to reduce visual clutter, and to do the right thing by default.
In C#, everything defaults to the least visibility possible. A class member (field, method, property) defaults to private. A class defaults to internal. A nested class defaults to private.
Thus if you omit your visibility except where you need it, you'll be automatically using the least visibility possible, which is the right way to do things anyway.
If you need something to be more visible, then add the modifier. This makes it easy to see items that deviate from the default visibility.
(Unfortunately, this rule only holds for C#. In VB .NET and in F#, the defaults are quite different and definitely not "least visibility possible" in most cases.)