I have a WPF window with a few controls (buttons, groupboxes, etc) and one big Viewport3D within a Border.
Viewport3D
Border
The viewport shows a 3D scene and I
You can try
KeyboardNavigation.TabNavigation = "Local"
for not shifting your focus outside the Viewport3D.