Robots.txt
If you don't currently use a robots.txt file, you can
create one
and then test it with the Google tool before you upload it to your
site.
Check out the following URL
http://www.google.com/support/webmasters/bin/topic.py?topic=8475
Our suggested text:-
User-agent: *
Allow: /
|