Hi Team, In the community dashboard, I see a lot of crawlers logging in to the site. I’m not able to know who they are and how they reached here. Who are these visitors? How can their activity and what kind of activity they are doing be looked into? How can they be tracked? Please help me with …

Hello Vidyaranjan, Try checking /admin/reports/web_crawlers for a detailed report on the crawlers. You can then proceed to block whichever one you do not find helpful or useful by adding them to the blocked crawler user agents site setting. That setting takes a case insensitive word that exists in …

Sorry to bump this, but I haven’t quite found what I am looking for. So for one, the crawler stats the reports page has to offer give me info on the number of crawler page views, and their user agents, but little else in terms of what to do with that information. Crawlers in general are not a proble…

[이미지] sebastianh: Can I remove crawlers from the main admin dashboard stats? Indeed you can. See at the top of the dashboard where ther are 3 options Logged in users Anonymous users Crawlers Just tap on crawlers and it will remove them. [sketch-1608379602088]

aha, thank you so much, never knew I could click on these

커뮤니티의 크롤러

커뮤니티 구축 데이터 및 보고

sebastianh (Rebastion) 12월 19, 2020, 12:19오후 5

아, 정말 감사합니다. 이걸 클릭할 수 있다는 건 처음 알았어요.

글		댓글	조회수
Make crawler/anon/logged-in toggle more discoverbale on the dashboard graph UX	6	692	3월 19, 2023
Controlling Web Crawlers For a Site Site Management how-to	10	2790	7월 19, 2025
Too many Crawlers, is that a problem? Data & reporting	6	2648	6월 25, 2020
Crawler-mania - what happened there? Support	2	585	1월 18, 2021
Can I ignore some user agents? Support	6	977	8월 23, 2022

커뮤니티의 크롤러

Related topics