I was able to achieve same using other layout (e.g. LinearLayout) by adding clickListener to child LinearLayout.