Prevent Matplotlib to stretch plot to only bbox of drawing area

Question

Please see below image:

I set the figure size of plt equal to something like (4,6) and set axis to off and margin to zero. The