问题
I need to hide all my sites pages to ALL the spider robots, except for the home page (www.site.com) that should be parsed from robots.
Does anyone knows how can i do that?
回答1:
add to all pages you do not want to index tag <meta name="robots" content="noindex" />
or you can create robots.txt in your document root and put there something like:
User-agent: *
Allow: /$
Disallow: /*
来源：https://stackoverflow.com/questions/12807657/hide-web-pages-to-the-search-engines-robots