Detect if light is on or not based on color detection on poor lightning conditions

Question

I want to detect if traffic light is on based on color detection. The problem is that, because of how sun light impacts on it, appears to be on when it\'s off. Currently i\'