Skip to content
AI training and dataset crawlers

What is Amazonbot?

Amazonbot is Amazon's web crawler. Amazon says it is used to improve its products and services and may be used to train Amazon AI models. Amzn-SearchBot and Amzn-User are separate agents for search and user actions.

Last verified 2026-09-30 against the operator's documentation. All bots

Amazonbot at a glance

Operator
Amazon
Type
AI training and dataset crawlers
Purpose
Crawls to improve Amazon products; may be used to train Amazon AI models.
robots.txt token
Amazonbot
Example user agent
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1) Chrome/W.X.Y.Z Safari/537.36
How to verify
Check that the source IP is in the addresses Amazon publishes for Amazonbot.

How often is Amazonbot impersonated?

For the median organisation, 1% of requests claiming to be Amazonbot failed verification.

Measured between 3 July 2026 and 28 September 2026 across organisations protected by Centinel. We only publish a share when at least five organisations each saw enough of these requests. Pooled across all of their requests, the share was under 1%: a few large organisations carry most of the traffic, so the median organisation is the better guide to what yours will see.

This directory measures requests between 3 July 2026 and 28 September 2026. The fake crawler report covers its own, earlier window (late June to 21 September 2026), so its figures differ from the ones here. Read it for the method.

Have a request that claims to be Amazonbot? Check its IP address.

Should you block Amazonbot?

Allow it if
you are content for Amazon to use your pages in its products and models.
Block it if
you do not want your content used for Amazon's AI training.
What blocking changes
Amazon stops crawling your pages with Amazonbot. Amzn-SearchBot and Amzn-User are controlled separately.

To block it, add this group to your robots.txt. Amazon says Amazonbot respects robots.txt and page-level noarchive and noindex tags, but not Crawl-delay.

User-agent: Amazonbot
Disallow: /

robots.txt only asks. It does nothing against a client that ignores it or only pretends to be Amazonbot. Stopping those takes verification at your edge.

Questions

Amazonbot: common questions

See which bots reach your site, and which of them are who they claim to be.

What is Amazonbot?

Amazonbot is Amazon's web crawler. Amazon says it is used to improve its products and services and may be used to train Amazon AI models. Amzn-SearchBot and Amzn-User are separate agents for search and user actions.

How do I verify that a request is really Amazonbot?

Check that the source IP is in the addresses Amazon publishes for Amazonbot. The user agent alone proves nothing: any client can send it.

How do I block Amazonbot in robots.txt?

Add a group for User-agent: Amazonbot with Disallow: /. Amazon says Amazonbot respects robots.txt and page-level noarchive and noindex tags, but not Crawl-delay. robots.txt only asks. A client that ignores it, or pretends to be Amazonbot, has to be stopped at your edge.

What happens if I block Amazonbot?

Amazon stops crawling your pages with Amazonbot. Amzn-SearchBot and Amzn-User are controlled separately.

Related bots

  • GPTBot (OpenAI): Crawls content that may be used to train OpenAI's foundation models.
  • ClaudeBot (Anthropic): Collects web content that could contribute to Claude model training.
  • Meta-ExternalAgent (Meta): Crawls for training AI models or improving Meta products.
  • CCBot (Common Crawl): Builds Common Crawl's open web archive, free for anyone to reuse.