If in the Web Crawler User Agents tab I have the name of the bot, that’s exactly what I have to enter in the options to make sure that the bot is blocked or another name ? for example MBCrawler/1.0 (https://monitorbacklinks.com/robot) then what should be input here [image] MBCrawler/1.0 or a…

Name of blacklisted user agent

codinghorror (Jeff Atwood) February 29, 2020, 8:23pm 2

I think monitorbacklinks would be best as it is the longest unique string.

2 Likes

Topic		Replies	Views
Too many Crawlers, is that a problem? Data & reporting	6	2473	June 25, 2020
Crawler-mania - what happened there? Support	3	502	February 17, 2021
Throttling user agents and settings format Support	4	811	July 13, 2021
Why semrushbot and ahrefsbot are blocked by default? Support	11	4393	December 3, 2020
Crawlers very high? Support	6	949	June 12, 2020