Will this robots.txt file only allow googlebot to index my site\'s index.php file? CAVEAT, I have an htaccess redirect that people who type in
http://www.example
Absent the redirect, Googlebot would not see your site, except for the index.php.
With the redirect, it depends on how the bot handles redirects and how your htaccess does the redirect. If you return a 302, then Googlebot will see http://www.example.com/
, check against robots.txt, and not see the main site. Even if you do an internal redirect and tell Googlebot that the responding page is http://www.example.com/
, it will see the page but might not index it.