# Has anyone seen the OpenAI web crawler GPTBot visit their site?

**URL:** <https://meta.discourse.org/t/has-anyone-seen-the-openai-web-crawler-gptbot-visit-their-site/274370>\
**Category:** Community Building\
**Created:** [August 8, 2023, 4:07pm UTC](https://meta.discourse.org/t/has-anyone-seen-the-openai-web-crawler-gptbot-visit-their-site/274370 "2023-08-08T16:07:50Z")\
**Posts on this page:** 1\
**Showing post:** 5

<div class="post-metadata">

**Author:** ![agemo](https://avatars.discourse-cdn.com/v4/letter/a/ac91a4/32.png) [@agemo](https://meta.discourse.org/u/agemo)\
**Post date:** [August 19, 2023, 7:43pm UTC](https://meta.discourse.org/t/has-anyone-seen-the-openai-web-crawler-gptbot-visit-their-site/274370/5 "2023-08-19T19:43:30Z")

</div>

Yes, first time to use the crawler report too, and lo and behold. There it was.

My take is it appeared in August, and it’s the largest crawler of them all.

Here is an example of a 24 hour period and the kind of ratio

**#1 ChatGPT 18K pageviews**  
#2 mj12bot 1.8K pageviews  
…  
#4 Google 1.7K pageviews

This discourse deployment was put into long\_required specially to stop dead the crawler getting at the content, so it must only be hitting the login\_required page to clock up those hits right?

Could it use a user?

I assume that is technically possible but not likely probable, and if so I would expect such a user to suddenly have a really high post read count.

Right now it looks to be close to 100K pageviews far in excess of the next highest which is approx. less than half.

chapgpt crawler is a monster

---

_[View the full topic](https://meta.discourse.org/t/has-anyone-seen-the-openai-web-crawler-gptbot-visit-their-site/274370)._