ScrollView doesn't work properly while using DragGesture

Question

I am using a ScrollView for LazyVGrid. To achieve press effect of the button I am using DragGesture. But than ScrollView doesn\'t scroll properly.

Visual representation:<