What is Claude-User?
Claude-User is the agent Anthropic uses when a person asks Claude a question that needs a web page. It retrieves content on demand rather than crawling.
Last verified 2026-09-30 against the operator's documentation. All bots
Claude-User at a glance
- Operator
- Anthropic
- Type
- AI user-triggered fetchers
- Purpose
- Fetches a page when a Claude user's question needs it.
- robots.txt token
Claude-User- How to verify
- Check that the source IP is in the ranges Anthropic publishes for its crawlers.
- Operator documentation
- https://support.claude.com/en/articles/8896518
How often is Claude-User impersonated?
For the median organisation, 33% of requests claiming to be Claude-User failed verification.
Measured between 3 July 2026 and 28 September 2026 across organisations protected by Centinel. We only publish a share when at least five organisations each saw enough of these requests. Pooled across all of their requests, the share was 27%: a few large organisations carry most of the traffic, so the median organisation is the better guide to what yours will see.
This directory measures requests between 3 July 2026 and 28 September 2026. The fake crawler report covers its own, earlier window (late June to 21 September 2026), so its figures differ from the ones here. Read it for the method.
Have a request that claims to be Claude-User? Check its IP address.
Should you block Claude-User?
- Allow it if
- you want the assistant to be able to read and cite your pages when someone asks about them.
- Block it if
- you do not want Claude fetching your pages for its users.
- What blocking changes
- Anthropic says Claude will not retrieve your content in response to user queries, which may reduce your visibility in user-directed web search.
To block it, add this group to your robots.txt. Anthropic says Claude-User lets site owners control these user-initiated requests through robots.txt.
User-agent: Claude-User
Disallow: /robots.txt only asks. It does nothing against a client that ignores it or only pretends to be Claude-User. Stopping those takes verification at your edge.
Claude-User: common questions
See which bots reach your site, and which of them are who they claim to be.
What is Claude-User?
Claude-User is the agent Anthropic uses when a person asks Claude a question that needs a web page. It retrieves content on demand rather than crawling.
How do I verify that a request is really Claude-User?
Check that the source IP is in the ranges Anthropic publishes for its crawlers. The user agent alone proves nothing: any client can send it.
How do I block Claude-User in robots.txt?
Add a group for User-agent: Claude-User with Disallow: /. Anthropic says Claude-User lets site owners control these user-initiated requests through robots.txt. robots.txt only asks. A client that ignores it, or pretends to be Claude-User, has to be stopped at your edge.
What happens if I block Claude-User?
Anthropic says Claude will not retrieve your content in response to user queries, which may reduce your visibility in user-directed web search.
Related bots
- ClaudeBot (Anthropic): Collects web content that could contribute to Claude model training.
- Claude-SearchBot (Anthropic): Indexes pages to improve Claude's search results.
- ChatGPT-User (OpenAI): Visits a page when a ChatGPT or Custom GPT user's request needs it.
- Perplexity-User (Perplexity): Fetches a page when a Perplexity user's request needs it.
- Meta-ExternalFetcher (Meta): Fetches individual links on behalf of Meta product users.
- MistralAI-User (Mistral AI): Fetches a page when a Mistral user's action needs it.