How does the googlebot metadata differ from robots?

The googlebot metadata is a specific directive for Google's crawler, while robots is a general directive for all crawlers.

The googlebot metadata is used to provide instructions specifically to Google's web crawler, Googlebot, about how to index and interact with a webpage. In contrast, the robots metadata provides directives to all compliant web crawlers, not just Googlebot. This allows webmasters to tailor their instructions to Google's crawler separately if needed.

<meta name="googlebot" content="noindex, nofollow">
<meta name="robots" content="index, follow">
More cards24
Show all