I think the value is too high. Is there something wrong? [ภาพ]

There has been a lot of churn around crawling rules lately due to Google changing their robots.txt behavior so this may be normal.

You can see who it is: /admin/reports/web_crawlers And add them here: admin/site_settings/category/all_results?filter=crawler user agents [imagem] How to block all crawlers but Google's feature About 1/3 of our traffic is from crawlers (about 250K last month). Is there…

[imagem] Stranik: /admin/reports/web_crawlers [ภาพ]

Except as your data shows, there is a rogue crawler! Block it via your site settings.

Crawlers muito altos?

Suporte

Stranik (Evgeny) Maio 13, 2020, 3:36pm 2

Você pode ver quem é:

/admin/reports/web_crawlers

E adicioná-los aqui:

admin/site_settings/category/all_results?filter=crawler user agents

Tópico		Respostas	Visualizações
How to block all crawlers but Google's Feature	1	4025	21 de Julho de 2019
Web Crawlers Data & reporting	12	1268	31 de Julho de 2023
Smarter handling of random crawler traffic Feature	2	3550	29 de Março de 2018
Crawler-mania - what happened there? Support	3	536	17 de Fevereiro de 2021
Too many Crawlers, is that a problem? Data & reporting	6	2546	25 de Junho de 2020

Crawlers muito altos?

Tópicos relacionados