# How self-hosted here are dealing with bad crawlers? **URL:** \ **Category:** Community Building\ **Created:** [April 10, 2025, 4:02pm UTC](https://meta.discourse.org/t/how-self-hosted-here-are-dealing-with-bad-crawlers/361280 "2025-04-10T16:02:49Z")\ **Posts on this page:** 1\ **Showing post:** 6
**Author:** ![paco](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/paco/32/547931_2.png) [@paco](https://meta.discourse.org/u/paco)\ **Post date:** [March 20, 2026, 3:41am UTC](https://meta.discourse.org/t/how-self-hosted-here-are-dealing-with-bad-crawlers/361280/6 "2026-03-20T03:41:19Z")
I wish I could say I had some solution that was free, or didn’t involve some outside service. I put my biggest forum behind [bunny.net](http://bunny.net)’s CDN. They have a generous free tier. But for that forum I go ahead and pay the $10/month to get their security service. It lets me block crawlers, DDoS, and geographically. As CDNs go, they’re really cheap but effective, and they’re not CloudFlare. A lot of folks on the fediverse rate them highly. I’ve a graph from their Shield service. (I’m a n00b, only 1 graph per reply 🙂 ) In the first, there were 484K bot connections out of 2M overall connections. I had just moved to the CDN and didn’t have any filtering or blocking in. The next shows 11K bots, and 90K blocked due to access lists (I block China and Russia and maybe a couple others). So that’s about 100K from bots on a total of 700K requests that week. After: ![Screenshot From 2026-03-15 09-25-53](https://global.discourse-cdn.com/meta/original/4X/8/0/6/806f7462b47858a2c2e2600e0e4bea0e4e2afaba.png) --- _[View the full topic](https://meta.discourse.org/t/how-self-hosted-here-are-dealing-with-bad-crawlers/361280)._