I don't have VS handy to test if this works, but have you tried handling the double-click event on the ListViewItems rather than the ListView itself?
That should handle the MouseDoubleClick event on any child ListViewItem controls inside the ListView. Let us know if it works!