How to stop SSH X11 forwarding when using vim?

Question

When I launch vim on command line via SSH connection with X11 forwarding (eg. ssh -X or set ssh_config X11Forwarding yes), XQuartz.app is also laun