Crawlers very high?

I think the value is too high. Is there something wrong?

You can see who it is:

/admin/reports/web_crawlers

And add them here:

admin/site_settings/category/all_results?filter=crawler user agents
4 Likes

3 Likes

There has been a lot of churn around crawling rules lately due to Google changing their robots.txt behavior so this may be normal.

2 Likes

ok thank you very much.

Except as your data shows, there is a rogue crawler! Block it via your site settings.

2 Likes

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.