Pandas: Getting NaN values when trying to replace non-numeric values with a numeric value

Question

I am trying to replace some none-numeric values in my dataframe with numeric values. For example, temporarily replacing "Red" with 1 and "Blue" with 0.