Can I block search crawlers for every site on an Apache web server?

前端 未结 6 1131
走了就别回头了
走了就别回头了 2021-01-31 05:13

I have somewhat of a staging server on the public internet running copies of the production code for a few websites. I\'d really not like it if the staging sites get indexed. <

6条回答
  •  陌清茗
    陌清茗 (楼主)
    2021-01-31 06:04

    Try Using Apache to stop bad robots. You can get the user agents online or just allow browsers, rather than trying to block all bots.

提交回复
热议问题