I have standard php fpm nginx config for websites. I need to deny all urls for user agent petalbot and mjbot but allow them access to robots.txt. How to do this?
