I think the value is too high. Is there something wrong? [ภาพ]

There has been a lot of churn around crawling rules lately due to Google changing their robots.txt behavior so this may be normal.

You can see who it is: /admin/reports/web_crawlers And add them here: admin/site_settings/category/all_results?filter=crawler user agents [画像] How to block all crawlers but Google's feature About 1/3 of our traffic is from crawlers (about 250K last month). Is there a w…

[画像] Stranik: /admin/reports/web_crawlers [ภาพ]

Except as your data shows, there is a rogue crawler! Block it via your site settings.

クローラーの数が非常に多い？

サポート

Stranik (Evgeny) 2020 年 5 月 13 日午後 3:36 2

誰がアクセスしているか確認できます：

/admin/reports/web_crawlers

ここで追加できます：

admin/site_settings/category/all_results?filter=crawler user agents

トピック		返信	表示
How to block all crawlers but Google's Feature	1	4025	2019 年 7 月 21 日
Web Crawlers Data & reporting	12	1268	2023 年 7 月 31 日
Smarter handling of random crawler traffic Feature	2	3550	2018 年 3 月 29 日
Crawler-mania - what happened there? Support	3	536	2021 年 2 月 17 日
Too many Crawlers, is that a problem? Data & reporting	6	2546	2020 年 6 月 25 日

クローラーの数が非常に多い？

関連トピック