What is AgentReadinessScanner?
AgentReadinessScanner is a bot operated by Cloudflare that scans websites to assess their readiness for AI agents by checking for emerging standards such as llms.txt, MCP, agent skills, markdown negotiation, and various API and commerce protocols. The bot provides website owners with a report on their site's compatibility with AI agent technologies across categories including discoverability, content accessibility, bot access control, protocol discovery, and commerce. You can set up Agent Analytics to see when AgentReadinessScanner visits your website.
Category
| Example User Agent | Mozilla/5.0 (compatible; AgentReadinessScanner/1.0; +https://isitagentready.com) |
| Operated By | Cloudflare |
| Source | Official Website |
| Triggered By | Scheduled or manual configuration |
| Used for AI Model Training | Not expected |
| Affects AI Chat & Search Visibility | Not directly |
| Expected To Follow Robots.txt | No |
Why Is AgentReadinessScanner Visiting My Website?
Someone, most likely on your own team, configured AgentReadinessScanner to check your site. Uptime monitors, performance testers, and audit tools visit only the sites or endpoints they are told to watch.
Should I Block AgentReadinessScanner?
Only if no one on your team relies on it. AgentReadinessScanner may support uptime monitoring, performance tests, or audits. Blocking it without checking first can silently disrupt those workflows. For context, 7% of the top websites we track currently have robots.txt rules for AgentReadinessScanner.
Insights for AgentReadinessScanner
As of November 1, 2026, this data reflects agent visits measured across thousands of websites using Agent Analytics, combined with daily scans of the top 1000 websites and their robots.txt files.
Robots.txt Compliance
Country of Origin
Robots.txt Blocked Percentage
Frequently Asked Questions
What Traffic Patterns Should I Expect From AgentReadinessScanner?
AgentReadinessScanner's traffic often follows fixed intervals like a cron job. Activity may consist of short recurring checks or occasional intensive bursts, but it usually remains limited to a specific set of pages or endpoints.
Does AgentReadinessScanner Follow Robots.txt Rules?
No. AgentReadinessScanner is not expected to follow robots.txt rules, so a disallow rule only communicates your preference. Enforce the block with firewall or server rules, then use Agent Analytics to verify that its requests stop.
Is AgentReadinessScanner Used for AI Model Training?
Not ordinarily. AgentReadinessScanner is not categorized as an AI training scraper or data provider, so AI model training is not its expected purpose.
Does Blocking AgentReadinessScanner Affect AI Search or Citations?
Not directly. AgentReadinessScanner's expected purpose is not to supply an AI search index or retrieve pages for AI-generated answers.
Does AgentReadinessScanner Access Private Content?
Only when configured with access. A team may grant AgentReadinessScanner credentials to monitor staging sites or private health endpoints. Without those credentials, it sees only public pages.
How Can I Verify a Request From AgentReadinessScanner?
Agent Analytics tracks AgentReadinessScanner visits in real time. You can also check your server logs for requests whose user-agent string contains "AgentReadinessScanner". Look for repeated checks of the same pages or endpoints at regular intervals. Because AgentReadinessScanner does not publish a verification method, any client can claim its identity and a log match is only a clue.
How Is AgentReadinessScanner Different From Other Cloudflare Agents?
Cloudflare operates separate agents for different purposes, so each agent should be evaluated and controlled independently.
- CloudflareBrowserRenderingCrawler: CloudflareBrowserRenderingCrawler is a web crawler operated by Cloudflare that returns rendered website content for research, monitoring, and AI data workflows.
- Cloudflare-AI-Search: Cloudflare-AI-Search is Cloudflare's web crawler that retrieves and indexes website content for AI Search, its managed search and retrieval service.
- Cloudflare-AI-Search-External: Cloudflare-AI-Search-External is a crawler operated by Cloudflare that retrieves website content for AI Search, its managed search and retrieval service.
- Cloudflare Browser Rendering: Cloudflare Browser Rendering is a serverless browser automation service that runs on Cloudflare Workers. It enables AI agents and applications to control a headless brows…
- bushbaby: bushbaby is a bot operated by Cloudflare, a company that provides web infrastructure and security services. This bot is likely used for monitoring, testing, or maintainin…