# Fix: robots.txt allows AI crawlers per-bot

robots.txt allows AI crawlers per-bot — AI Pipeline Visibility. Do AI data pipelines actually have your pages?

## Requirements

- Name AI crawlers explicitly in robots.txt (CCBot, GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended) with Allow: /, instead of relying on a silent wildcard. Explicit beats unmentioned.

## Validate

Re-run an AI Readiness scan on the site URL and confirm the "robots.txt allows AI crawlers per-bot" check reports `pass`.
The result carries a stable `messageRef` of `check.robots-ai-bots.pass` when it passes.
