The robots meta tag is a page-level HTML directive, placed in the document head, that tells search engines how to crawl, index, and display that page in results.
| Term | Robots Meta Tag |
|---|---|
| Category | Page Structure and Technical SEO |
| Also known as | Meta Robots |
| Where it appears | Technical factors |
What it means in RankGear
RankGear surfaces the robots meta tag under its Technical factors. When RankGear renders a page, it looks in the document head for a <meta name="robots"> element and reads its directive values — things like index/noindex and follow/nofollow. Because the tag governs whether a page is eligible to appear in search at all, RankGear treats its presence and contents as a factual signal about the page’s indexing intent rather than a quality score.
How to interpret it
Read both whether the tag exists and what it actually says in the rendered DOM, not just the raw source. A tag can be present but empty, contradicted by an HTTP X-Robots-Tag header, or unintentionally set to noindex on a page you want indexed. The most consequential cases are the ones that remove a page from search — a stray noindex on an important URL — so compare the directive on your page against the directives on the ranking pages you are measuring against.
| Directive | What it tells the engine |
|---|---|
| index / noindex | Whether the page may appear in the index at all |
| follow / nofollow | Whether links on the page pass signals onward |
| noarchive | Suppress the cached copy of the page |
| nosnippet | Suppress the text snippet and preview in results |
Example
You are auditing a product page that dropped out of the results. RankGear renders the page and finds <meta name="robots" content="noindex, follow"> in the head, while the three pages currently ranking for the query all carry index, follow or no robots tag at all. That single directive explains the disappearance: the page is telling search engines not to index it, regardless of how strong its content is.
Important considerations
- The tag controls eligibility and presentation, not position — a correct
index, followvalue lets a page compete but does not make it rank. - Presence is not correctness: verify the rendered value, since a directive can be empty, duplicated, or overridden by an
X-Robots-TagHTTP header. - The robots meta tag differs from robots.txt: the meta tag governs indexing of a page the crawler has already fetched, whereas robots.txt governs whether the crawler fetches the URL in the first place.
- Comparisons against ranking pages are indicators of technical conformance, not causal Google scores; RankGear reports what the tag says, not what it earns.
Related terms
Part of the RankGear glossary · how RankGear measures · the 870 factors.