Remove rows that are not a number or a date from pandas dataframe

Question

I have a similar question to this (Remove non-numeric rows in one column with pandas) except my rows have both numbers and dates in them. How do I remove all rows that have