How to stop listening and recv data from only one user and start listening again when he disconnects

Question

I am trying to write a server-client program. The idea is that server

1. listens() on the given port
2. When a user connects it accepts() the connection and