How to configure robots.txt to allow everything?

前端 未结 4 666
北海茫月
北海茫月 2021-01-30 04:46

My robots.txt in Google Webmaster Tools shows the following values:

User-agent: *
Allow: /

What does it mean? I don\'t have enough

4条回答
  •  悲哀的现实
    2021-01-30 05:24

    It means you allow every (*) user-agent/crawler to access the root (/) of your site. You're okay.

提交回复
热议问题