So with my nexus 5 im easily able to do something like this to connect adb over wifi:
adb tcpip 5555 adb connect 192.xxx.x.xx
and then disconne
For some reason, connecting the device in Charge only mode solved the problem. Just make sure "Allow ADB debugging in charge only mode" is enabled before connecting the device.
https://stackoverflow.com/a/51904546/4470297