How to cut out a square or rectangle with specific color from image (OpenCV, Numpy) at any direction?

Question

I\'m very much starter to python. Can I get some help for the scenario as below?

Sample input images :

Sample Rectangle 1

Sample Rectangle 2

Expected