# Amazonbot abusive crawling

**URL:** <https://meta.discourse.org/t/amazonbot-abusive-crawling/188803>\
**Category:** Product Support\
**Created:** [May 1, 2021, 10:53am UTC](https://meta.discourse.org/t/amazonbot-abusive-crawling/188803 "2021-05-01T10:53:35Z")\
**Posts on this page:** 1\
**Showing post:** 7

<div class="post-metadata">

**Author:** ![mcdanlj](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/mcdanlj/32/131829_2.png) [@mcdanlj](https://meta.discourse.org/u/mcdanlj)\
**Post date:** [February 5, 2023, 6:14pm UTC](https://meta.discourse.org/t/amazonbot-abusive-crawling/188803/7 "2023-02-05T18:14:06Z")

</div>

Since I myself was just hit by something like this…

I’m very happy for Alexa to be able to use my site content to answer questions, so I don’t really want to block it. However, I just saw a burst of three days of heavy traffic from AmazonBot (relative to all other site usage, including all other bots combined, as well as all other site traffic overall), and I see that Amazon says:

> AmazonBot does not support the `crawl-delay` directive in robots.txt

It seems like it is prudent, therefore, to add `Amazonbot` to `slow_down_crawler_user_agents` so that they do not have an outsized impact on site performance for users.

Thanks, Discourse folks, for implementing functionality that crawlers ought to, but in this case do not. ❤

---

_[View the full topic](https://meta.discourse.org/t/amazonbot-abusive-crawling/188803)._