Validation
Meta Robots Checker
Detects noindex, nofollow, no archive and X-Robots-Tag directives to check if a page can be crawled and indexed correctly.
INFO
WHAT DOES THE META ROBOTS CHECKER CHECK?
This tool reviews crawling and indexing directives declared in the HTML and in possible HTTP headers.
An accidental noindex can remove a valid page from search results, even if the content and structure are well optimized.
-
Meta robots:
Finds directives declared in meta tags.
-
X-Robots-Tag:
Allows reviewing directives sent via HTTP headers.
-
Critical blocks:
Flags noindex, none, or dangerous combinations.
-
Clear reading:
Summarizes whether the page is indexable or needs review.
Questions about Meta Robots
Common questions about noindex, nofollow, and indexing signals.
What does noindex do?
It tells search engines not to include that page in the index, although they may still crawl it.
Are meta robots and robots.txt the same?
No. robots.txt controls crawling access. Meta robots applies to a specific page once it is loaded.
Can X-Robots-Tag block a page?
Yes. An HTTP header with noindex can prevent indexing even if the HTML appears correct.