I think the value is too high. Is there something wrong? [ภาพ]

There has been a lot of churn around crawling rules lately due to Google changing their robots.txt behavior so this may be normal.

You can see who it is: /admin/reports/web_crawlers And add them here: admin/site_settings/category/all_results?filter=crawler user agents [imagen] How to block all crawlers but Google's feature About 1/3 of our traffic is from crawlers (about 250K last month). Is there…

[imagen] Stranik: /admin/reports/web_crawlers [ภาพ]

Except as your data shows, there is a rogue crawler! Block it via your site settings.

¿Los rastreadores muy altos?

Soporte

Stranik (Evgeny) 13 Mayo, 2020 15:36 2

Puedes ver quién es:

/admin/reports/web_crawlers

Y agregarlos aquí:

admin/site_settings/category/all_results?filter=crawler user agents

Tema		Respuestas	Vistas
How to block all crawlers but Google's Feature	1	4025	21 Julio 2019
Web Crawlers Data & reporting	12	1268	31 Julio 2023
Smarter handling of random crawler traffic Feature	2	3550	29 Marzo 2018
Crawler-mania - what happened there? Support	3	536	17 Febrero 2021
Too many Crawlers, is that a problem? Data & reporting	6	2546	25 Junio 2020

¿Los rastreadores muy altos?

Temas relacionados