How to efficiently vectorize (i.e. avoid explicit loops) a mapping of some colours into others in a Numpy array

Question

I have as input a Numpy matrix of rank three (i.e. an image: horizontal, vertical and 4 color channels). I want to read this matrix element-wise in their first two indices and m