What is Claude-Agent?
Claude-Agent is Anthropic's cloud browser agent for Claude Duet. It navigates websites and completes multi-step tasks on behalf of users. You can set up Agent Analytics to see when Claude-Agent visits your website.
Category
| Operated By | Anthropic |
| Source | Official Website |
| Triggered By | User action |
| Used for AI Model Training | Not expected |
| Affects AI Chat & Search Visibility | Possibly |
| Expected To Follow Robots.txt | No |
Why Is Claude-Agent Visiting My Website?
A user gave Claude-Agent a task that your site may help complete, such as researching a product, comparing options, or filling out a form. It likely reached your site through links or search results, much like a person would.
Should I Block Claude-Agent?
Usually not. Claude-Agent browses on behalf of a person trying to read, compare, or buy something on your site. Blocking it may prevent that person from completing the task and send them elsewhere. It does not affect traditional search rankings. Almost none of the top websites we track currently have robots.txt rules for Claude-Agent.
Insights for Claude-Agent
As of November 3, 2026, this data reflects agent visits measured across thousands of websites using Agent Analytics, combined with daily scans of the top 1000 websites and their robots.txt files.
Robots.txt Compliance
Country of Origin
Robots.txt Blocked Percentage
Claude-Agent Traffic
Frequently Asked Questions
What Traffic Patterns Should I Expect From Claude-Agent?
Claude-Agent operates a real browser, loading pages, running JavaScript, setting cookies, and navigating multi-step flows much like a person would. Because its route reflects the task it was given rather than a fixed crawl order, visits may look irregular. A session may pause while the agent processes a page, then continue somewhere unexpected.
Does Claude-Agent Follow Robots.txt Rules?
No. Claude-Agent is not expected to follow robots.txt rules, so a disallow rule only communicates your preference. Use Bad Bot Blocking to reject its requests, then use Agent Analytics to verify that they stop.
Is Claude-Agent Used for AI Model Training?
Not ordinarily. Claude-Agent is not categorized as an AI training scraper or data provider, so AI model training is not its expected purpose.
Does Blocking Claude-Agent Affect AI Search or Citations?
Blocking Claude-Agent can prevent people using the agent from accessing or acting on your website. It does not directly control whether your pages appear in an AI search index.
Does Claude-Agent Access Private Content?
Possibly, if a user grants access. Claude-Agent operates a real browser session, so when someone signs in through it, the agent can see anything available to that account. Without credentials, it can reach only what an anonymous visitor can.
How Can I Verify a Request From Claude-Agent?
Agent Analytics tracks Claude-Agent visits in real time. You can also check your server logs for requests whose user-agent string contains "Claude-Agent". Look for browser-like sessions that move through pages faster or more methodically than a typical person. Because Claude-Agent does not publish a verification method, any client can claim its identity and a log match is only a clue.
How Is Claude-Agent Different From Other Anthropic Agents?
Anthropic operates separate agents for different purposes, so each agent should be evaluated and controlled independently.
- Claude-User: Claude-User is dispatched by Anthropic's Claude AI assistant in response to user prompts, when it needs to fetch content to include in its answers.
- Claude-Code: Claude Code is an AI coding agent by Anthropic that can build, debug, and ship code directly from the terminal, handling tasks like codebase onboarding, multi-file edits,…
- ClaudeBot: ClaudeBot is a web crawler operated by Anthropic to download training data for its LLMs (Large Language Models) that power AI products like Claude.
- Claude-SearchBot: Claude-SearchBot is used to create an index of websites that can be surfaced as results in Anthropic's Claude AI assistant search feature.
- anthropic-ai: anthropic-ai is a unconfirmed agent possibly used by Anthropic to download training data for its LLMs (Large Language Models) that power AI products like Claude.