Heard on annother thread @simon mention that there is a setting to stop/smash crawlers, can’t find this setting how to do this does anyone know where this is and how it works? Had an unusual spike of 48 crawlers at my site July 14th, I don’t like these little buggers what are they doing? [graph]

There’s also a guide here you can refer to: [afbeelding] Controlling Web Crawlers For a Site Site Management bookmark This guide explains how to manage web crawlers on your Discourse site. person_raising_hand Required user level: Administrator Web crawlers …

Web Crawlers

Gemeenschap Gegevens en rapportage

JammyDodger 17 juli 2023 om 07:20 7

There’s also a guide here you can refer to:

2 likes

Topic		Antwoorden	Weergaven
How to block all crawlers but Google's Feature	1	3996	21 juli 2019
Crawlers very high? Support	6	978	12 juni 2020
Controlling Web Crawlers For a Site Site Management how-to	10	2484	19 juli 2025
Crawler-mania - what happened there? Support	3	526	17 februari 2021
Have AI identify and flag web crawlers Feature ai	1	234	11 juli 2023

Web Crawlers

Gerelateerde topics