<META name googlebot>
Description:
Generally you should not need to worry about which pages within your site are indexed by the Google search engine (which uses the Googlebot spider). By default, Google will attempt to spider every page you have on your site.
Occasionally there are valid reasons why you do not want this to occur. Perhaps you have a slideshow presentation which needs to be viewed from start to finish. It would be awkward for someone to be dumped in the middle of the presentation.
In this case, you can use the ROBOTS metatag to control the behavior of all spiders, and the GOOGLEBOT Metatag to control exactly which pages are indexed by Google.
Attributes:
| <meta name="Googlebot" content="text"> | |||||||||||||||||
text is one of the following four combinations.
|
|||||||||||||||||
Examples:
<meta name="GOOGLEBOT" content="noindex,nofollow"> |
Don't index the current page, and do not continue following links from the page.