# Fix: robots.txt doesn't block AI crawlers

robots.txt doesn't block AI crawlers — AI Discovery. Can AI systems find and understand the site?

## Requirements

- Remove blanket Disallow rules for GPTBot, ClaudeBot, PerplexityBot etc. — blocking them hides the site from AI answers.

## Validate

Re-run an AI Readiness scan on the site URL and confirm the "robots.txt doesn't block AI crawlers" check reports `pass`.
The result carries a stable `messageRef` of `check.robots-ai.pass` when it passes.
