RecyclerView Selection library - clicking too fast lets the click pass through to my OnClickListener

Question

I\'m using the RecyclerView selection library but my ViewHolders also have their own OnClickListeners. When I select items quickly after another, or double-tap an it