Free Indexability Checker
Before you worry about rankings or AI citations, confirm search engines can index your pages. We check noindex directives, X-Robots-Tag headers, robots.txt blocks, and response status in one report.
Website URL to analyze
Ready to publish
Generated file
Recommended actions
Prioritised fixes — highest discoverability impact first
Before you worry about rankings or AI citations, confirm search engines can index your pages. We check noindex directives, X-Robots-Tag headers, robots.txt blocks, and response status in one report.
Confirm search engines can index your pages — before worrying about rankings or AI citations, fix noindex blocks, HTTP errors, and robots.txt disallow rules.
In your free report
- meta robots and X-Robots-Tag noindex/nofollow directives
- robots.txt Disallow rules affecting the scanned URL path
- HTTP response status (200 vs 4xx/5xx)
- Canonical tag pointing away from the scanned URL
Recommendations from official docs
Indexability comes before rankings
A page must be crawlable and indexable before it can rank or appear in AI search. Fix 404/5xx errors and noindex tags on money pages first.
Use noindex intentionally
Apply noindex to thank-you pages, internal search results, thin duplicates, and staging — not to important product or blog URLs by mistake.
Align canonical with index intent
If a URL canonicalizes to another page, Google may index the canonical target instead. Ensure the URL you want indexed is the canonical itself or points correctly.
Check rendered vs raw HTML
JavaScript-only noindex tags may not appear in initial HTML. Our visibility gap check helps catch content bots cannot see without rendering.
Step-by-step action plan
- 1 Remove accidental noindex from <meta name="robots"> on pages you want indexed.
- 2 Verify X-Robots-Tag response headers are not set to noindex at CDN or origin.
- 3 Update robots.txt to Allow important paths blocked by overly broad Disallow: / rules.
- 4 Fix HTTP errors — return 200 for live pages, 301 for permanent moves, 410 for gone content.
- 5 Re-scan after fixes and monitor Coverage report in Google Search Console.
Need help fixing AI SEO issues?
Optimize your website for AI SEO, ChatGPT Search, Google AI Overviews, GPTBot, llms.txt, robots.txt, schema, and crawlability.
Questions about this tool
What makes a page non-indexable?
Common causes include noindex meta tags, X-Robots-Tag headers, robots.txt blocks, or HTTP errors on the URL.
Does indexable mean ranked?
No. Indexable means search engines may include the page. Ranking depends on many other quality and relevance signals.