how can I drop rows in pandas where count and sum are 1

Question

my data frame looks like this:

ID      Values
0        0
2        0
3        1
5        0
5        1
8        0
9        0
10       1
11       1
12       1