# Spiders are making up the majority of our traffic!
**URL:** https://meta.discourse.org/t/spiders-are-making-up-the-majority-of-our-traffic/321630
**Category:** Support
**Created:** [August 14, 2024, 12:20pm UTC](https://meta.discourse.org/t/spiders-are-making-up-the-majority-of-our-traffic/321630 "2024-08-14T12:20:35Z")
**Posts on this page:** 5
**Page:** 1
### Author:  [@spdegabrielle](https://meta.discourse.org/u/spdegabrielle)
#### Post date: [August 14, 2024, 12:20pm UTC](https://meta.discourse.org/t/spiders-are-making-up-the-majority-of-our-traffic/321630/1 "2024-08-14T12:20:36Z")
I’m an admin on a free instance for open source kindly provided by the lovely people at Discourse.
I see part of being a good person is not abusing this kindness by using resources beyond the conditions of the free service.
Sadly, spiders have been taking the majority of our allocation of views and only seem to be getting worse. (Does anyone else suffer from this?)
Can anyone make any suggestions to help mitigate this issue?
Best regards
Stephen
---
### Author:  [@Jagster](https://meta.discourse.org/u/Jagster)
#### Post date: [August 14, 2024, 1:01pm UTC](https://meta.discourse.org/t/spiders-are-making-up-the-majority-of-our-traffic/321630/2 "2024-08-14T13:01:33Z")
You can ban most of bots. It helps. But Discourse doesn’t care when a WordPress would be on its knees.
How to catch humans… well, tell to all of us when you figure out it.
---
### Author:  [@supermathie](https://meta.discourse.org/u/supermathie)
#### Post date: [August 14, 2024, 8:59pm UTC](https://meta.discourse.org/t/spiders-are-making-up-the-majority-of-our-traffic/321630/3 "2024-08-14T20:59:12Z")
Thanks for the appreciation; with the increase in scraping going on this has been a concern for many of our customers.
You can [check your bot report and block the most egregious crawlers from your site](https://meta.discourse.org/t/controlling-web-crawlers-for-a-site/244925), that’d be a good start.
We’re looking at developing better tools for managing this, but for the next while unless it becomes a DRASTIC problem, don’t worry about it. ❤
---
### Author:  [@Jagster](https://meta.discourse.org/u/Jagster)
#### Post date: [August 15, 2024, 5:41am UTC](https://meta.discourse.org/t/spiders-are-making-up-the-majority-of-our-traffic/321630/4 "2024-08-15T05:41:21Z")
The only issue with that is UI. Adding those Discourse way is kind of pain somewhere, because there is quite many of those useless SEO-bots and other content stealers. If we had some way to send list or something 😏
---
### Author:  [@system](https://meta.discourse.org/u/system)
#### Post date: [September 14, 2024, 5:42am UTC](https://meta.discourse.org/t/spiders-are-making-up-the-majority-of-our-traffic/321630/5 "2024-09-14T05:42:06Z")
This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.