Heard on annother thread @simon mention that there is a setting to stop/smash crawlers, can’t find this setting how to do this does anyone know where this is and how it works? Had an unusual spike of 48 crawlers at my site July 14th, I don’t like these little buggers what are they doing? [graph]

There’s also a guide here you can refer to: [image] Controlling Web Crawlers For a Site Site Management When a site notices a spike in their pageviews it’s important to check how web crawlers fit into the mix. How to see if your site is hit by crawlers Head to the Conso…

Web Crawlers

data & reporting

JammyDodger July 17, 2023, 7:20am 7

There’s also a guide here you can refer to:

2 Likes

Topic		Replies	Views
Controlling Web Crawlers For a Site Site Management how-to	6	1823	April 24, 2024
Crawler-mania - what happened there? support	3	499	February 17, 2021
Too many Crawlers, is that a problem? data & reporting	6	2431	June 25, 2020
Help me understand the Anonymous Users statistics data & reporting	9	1084	April 5, 2019
Crawlers in the community data & reporting	5	1379	December 21, 2020

Web Crawlers

Related Topics