I think the value is too high. Is there something wrong? [ภาพ]

There has been a lot of churn around crawling rules lately due to Google changing their robots.txt behavior so this may be normal.

You can see who it is: /admin/reports/web_crawlers And add them here: admin/site_settings/category/all_results?filter=crawler user agents [Bild] How to block all crawlers but Google's feature About 1/3 of our traffic is from crawlers (about 250K last month). Is there a…

[Bild] Stranik: /admin/reports/web_crawlers [ภาพ]

Except as your data shows, there is a rogue crawler! Block it via your site settings.

Crawler sehr hoch?

Unterstützung

Stranik (Evgeny) 13. Mai 2020 um 15:36 2

Sie können sehen, wer es ist:

/admin/reports/web_crawlers

Und sie hier hinzufügen:

admin/site_settings/category/all_results?filter=crawler user agents

Thema		Antworten	Aufrufe
How to block all crawlers but Google's Feature	1	4030	21. Juli 2019
Web Crawlers Data & reporting	12	1269	31. Juli 2023
Smarter handling of random crawler traffic Feature	2	3550	29. März 2018
Crawler-mania - what happened there? Support	3	545	17. Februar 2021
Too many Crawlers, is that a problem? Data & reporting	6	2548	25. Juni 2020

Crawler sehr hoch?

Verwandte Themen