How to dynamically unselect a RectangleSelector?

Question

I\'m using a RectangleSelector to interactivelly zoom in in a Mandelbrot set plot in matplotlib.

The user selects a rectangle, double clicks