While it is possible to over test (point of diminishing returns) it's hard to do so. Testing (particularly testing early in the process) saves time. The longer a defect stays in a product the more it costs to fix.
Test early test often and test as completely as is practical!
