Removing a value in a specific row of a column without removing the entire row in a pandas dataframe

Question

If I have a csv that looks like this, the first A,B,C being the column headers:

A, B, C

A1,A2,A3
blah,B2,B3
C1,C2,C3
blah,D4,D5

How do I rem