- Courses
- HTML
- HTML top level tags
- <meta>
- Googlebot vs robots metadata differences
How does the googlebot
metadata differ from robots
?
The googlebot metadata is a specific directive for Google's crawler, while robots is a general directive for all crawlers.
The googlebot
metadata is used to provide instructions specifically to Google's web crawler, Googlebot, about how to index and interact with a webpage. In contrast, the robots
metadata provides directives to all compliant web crawlers, not just Googlebot. This allows webmasters to tailor their instructions to Google's crawler separately if needed.
<meta name="googlebot" content="noindex, nofollow">
<meta name="robots" content="index, follow">