# Web Crawlers

**URL:** <https://meta.discourse.org/t/web-crawlers/271767>\
**Category:** Data & reporting\
**Created:** [July 16, 2023, 6:41am UTC](https://meta.discourse.org/t/web-crawlers/271767 "2023-07-16T06:41:00Z")\
**Posts on this page:** 1\
**Showing post:** 3

<div class="post-metadata">

**Author:** ![simon](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/simon/32/339122_2.png) [@simon](https://meta.discourse.org/u/simon)\
**Post date:** [July 16, 2023, 1:48pm UTC](https://meta.discourse.org/t/web-crawlers/271767/3 "2023-07-16T13:48:35Z")

</div>

Also, have a look at the “Web Crawler User Agents” report to get the name of the crawler that’s causing the issue:

 ![image](https://global.discourse-cdn.com/meta/original/4X/f/2/f/f2f2f68d6b194f9e038d2a1bbd38f869377f7f20.png)

---

_[View the full topic](https://meta.discourse.org/t/web-crawlers/271767)._