Free Technical SEO Tool

Robots.txt & AI Search Bot Validator

Inspect whether your website's robots.txt allows generative AI scrapers (ChatGPT, Claude, Perplexity) or if your business is accidentally hidden from AI search results.

Active Robots.txt Directives

AI Search Crawler Status

Generative Engine Indexing

GPTBot (OpenAI)
ChatGPT web search citations
Allowed
PerplexityBot
Perplexity live answer engine
Allowed
ClaudeBot (Anthropic)
Claude research context
Allowed