Mirror with Unity SetParent on network object in client destroys un-owned objects

Question

I am making a UI system in Unity and using Mirror to allow multiplayer. I have slots for each player, and each player should assign units to his slots. The slots are network