I think the value is too high. Is there something wrong?
You can see who it is:
/admin/reports/web_crawlers
And add them here:
admin/site_settings/category/all_results?filter=crawler user agents
4 إعجابات
There has been a lot of churn around crawling rules lately due to Google changing their robots.txt behavior so this may be normal.
إعجابَين (2)
ok thank you very much.
Except as your data shows, there is a rogue crawler! Block it via your site settings.
إعجابَين (2)
This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.