FYI, .NET 4 includes a new method, Directory.EnumerateFiles, that does exactly what you need is awesome. Chances are you're not using .NET 4, but it's worth remembering anyway!
Edit: I now realise that the OP wanted the NUMBER of files. However, this method is so useful I'm keeping this post here.