Amazonbot in robots.txt
Amazonbot is Amazon's crawler. Here's exactly what it does, whether it respects robots.txt, and the rules to control it. To apply a policy in one click, use the AI Crawler Manager.
What Amazonbot is
Amazonbot is Amazon's web crawler. It indexes content to improve Amazon products and services, including Alexa's ability to answer questions and Amazon's AI features. It honors robots.txt and does not affect search-engine rankings.
| Property | Value |
|---|---|
| User-agent | Amazonbot |
| Operator | Amazon |
| Category | Other / data crawlers |
| Honors robots.txt | Yes |
| Affects search ranking | No |
Official documentation: Amazon crawler docs.
What Amazonbot does
- Crawls pages so Alexa and Amazon services can answer questions and surface information.
- Supports Amazon's broader product and AI initiatives.
Why site owners care
- Allowing it can let Alexa answer using your content; blocking it opts you out of Amazon AI uses.
- It is not a search engine, so it does not influence Google/Bing visibility.
How to allow or block Amazonbot
Add a group targeting the Amazonbot user-agent. Disallow: / blocks it from your whole site; an empty Disallow: allows it.
User-agent: Amazonbot
Disallow: /User-agent: Amazonbot
Disallow:No effect on search ranking
How to verify Amazonbot
Verify via reverse DNS to a crawl.amazonbot.amazon host with forward confirmation, per Amazon's docs.
Does it honor robots.txt?
Recommendation
Recommended: Depends
What is Amazonbot used for?
Amazonbot crawls the web to support Amazon products and services, including Alexa answering user questions and Amazon's AI features. It is not a search-engine crawler.
Should I block Amazonbot?
It depends. Allow it if you want Alexa and Amazon services to use your content; block it if you'd rather opt out of Amazon's data collection and AI use. Either way, your Google and Bing rankings are unaffected.
AI Crawler Manager
Allow or block GPTBot, ClaudeBot, PerplexityBot and more in one place.
Robots.txt Studio Editorial · Technical SEO & crawling
We build robots.txt tooling and parse thousands of real-world files. Guides are written by practitioners and reviewed against the Google and RFC 9309 specifications.