Lumen returning 500 from client when being indexed by Bing and Google - can I block these requests?

Question

Let me try and set this up. I have my client, we\'ll call client.com and I want all my pages in this site indexed. Then there is the api, we\'ll call api.