# How self-hosted here are dealing with bad crawlers?

**URL:** <https://meta.discourse.org/t/how-self-hosted-here-are-dealing-with-bad-crawlers/361280>\
**Category:** Community Building\
**Created:** [April 10, 2025, 4:02pm UTC](https://meta.discourse.org/t/how-self-hosted-here-are-dealing-with-bad-crawlers/361280 "2025-04-10T16:02:49Z")\
**Posts on this page:** 1\
**Showing post:** 5

<div class="post-metadata">

**Author:** ![RGJ](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/rgj/32/523185_2.png) [@RGJ](https://meta.discourse.org/u/RGJ)\
**Post date:** [April 11, 2025, 9:22am UTC](https://meta.discourse.org/t/how-self-hosted-here-are-dealing-with-bad-crawlers/361280/5 "2025-04-11T09:22:26Z")

</div>

I agree, the AI tag has a plugin icon so I assume it is meant for the AI _plugin_ only. I’ve removed it.

> [@eisammy](#):
>
> crawlers practically doing DDoS non-stop

Crawler content gets heavily cached so in practice I’ve never seen them to be able to DDoS.

Are you actually having performance issues because of this?

---

_[View the full topic](https://meta.discourse.org/t/how-self-hosted-here-are-dealing-with-bad-crawlers/361280)._