Gesture detection when transform widget is applied

Question

I can\'t seem get proper gesture detection when applying a Matrix to a widget. My best guess is that it has something to do with FractionallySizedBox. Here is a