Has anyone seen the OpenAI web crawler GPTBot visit their site?

No, well yes kinda, see I couldn’t read it as it was truncated but I think it is AppleWebKit crawler. I’d need to export the data to read the full entry.

Since then I have blocked virtually all crawlers even though it is the same as you in a login_required private forum. Crawlers have dropped to 20 so far today, compared to nearly 14,000 a few days ago!

2 Likes