I think the value is too high. Is there something wrong?
You can see who it is:
/admin/reports/web_crawlers
And add them here:
admin/site_settings/category/all_results?filter=crawler user agents
4 Likes
There has been a lot of churn around crawling rules lately due to Google changing their robots.txt behavior so this may be normal.
2 Likes
ok thank you very much.
Except as your data shows, there is a rogue crawler! Block it via your site settings.
2 Likes
This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.