How to remove whitespace between numbers only?

Question

I have a bunch of directories named differently like this:

firstname lastname (123) 456 7890
firstname lastname (234) 567-8910
firstname lastname 345-678-9101