How to control camera rig orientation with optically tracked pinch in A-frame?

Question

I wanna replicate what this guy does. Basically, you go back and forth from one corner of your room to another and rotate the scene when you reach the guardian fence.