First remove a Tab from the collection, then Dispose(). Never Dispose() something that is still in use, as it will cause exceptions and strange behavior.
Also, ensure that no one else have references to the tabs, otherwise those references will become invalid on Dispose().