# Crawlers very high?

**URL:** https://meta.discourse.org/t/crawlers-very-high/151339
**Category:** Support
**Created:** [May 13, 2020, 3:00pm UTC](https://meta.discourse.org/t/crawlers-very-high/151339 "2020-05-13T15:00:15Z")
**Posts on this page:** 1
**Showing post:** 2

<div class="post-metadata">

### Author: ![Stranik](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/stranik/32/85638_2.png) [@Stranik](https://meta.discourse.org/u/Stranik)
#### Post date: [May 13, 2020, 3:36pm UTC](https://meta.discourse.org/t/crawlers-very-high/151339/2 "2020-05-13T15:36:48Z")

</div>

You can see who it is:

```plaintext
/admin/reports/web_crawlers

```

And add them here:

```plaintext
admin/site_settings/category/all_results?filter=crawler user agents

```

> [@How to block all crawlers but Google's](https://meta.discourse.org/t/how-to-block-all-crawlers-but-googles/62431):
>
> About 1/3 of our traffic is from crawlers (about 250K last month). Is there a way to block these but allow Google’s crawlers?

---

_[View the full topic](https://meta.discourse.org/t/crawlers-very-high/151339)._