Robots.txt & Noindex Checker
See what your robots.txt actually allows Googlebot and Bingbot to crawl — then check individual pages for noindex tags, redirects and errors.
Part A — Check robots.txt
We fetch the robots.txt of your site and show which paths each crawler may and may not visit.
Part B — Check URLs for noindex
Up to 20 URLs at a time. Each page is fetched and checked for noindex in its meta robots tag and X-Robots-Tag header, plus its HTTP status and redirects.
Paste up to 20 URLs above and click Check URLs.
A page is "Indexable" when it returns HTTP 200 with no noindex tag. A page blocked in robots.txt can only be judged from Part A — this check does not fetch robots.txt per URL.
| URL | Status | Verdict | Final URL | X-Robots-Tag | Meta robots |
|---|
What the verdicts mean
- Indexable — the page returns HTTP 200 with no noindex in its meta robots tag or X-Robots-Tag header.
- Noindex tag — the page tells search engines not to index it, via a meta robots tag or an X-Robots-Tag header.
- Redirect — the URL redirects (3xx) to another page; the final URL is shown.
- 404 — the page does not exist.
- Check failed — the page could not be fetched at all. This does not mean the page is not indexed; it means this check could not tell.
Found a page you want search engines to notice? Submit it with IndexNow or the Google Indexing API.