If in the Web Crawler User Agents tab I have the name of the bot, that’s exactly what I have to enter in the options to make sure that the bot is blocked or another name ? for example MBCrawler/1.0 (https://monitorbacklinks.com/robot) then what should be input here [image] MBCrawler/1.0 or a…

Name of blacklisted user agent

codinghorror (Jeff Atwood) February 29, 2020, 8:23pm 2

I think monitorbacklinks would be best as it is the longest unique string.

2 Likes

Topic		Replies	Views
Crawler-mania - what happened there? Support	3	511	February 17, 2021
Web Crawlers Data & reporting	12	1158	July 31, 2023
Throttling user agents and settings format Support	4	818	July 13, 2021
Why semrushbot and ahrefsbot are blocked by default? Support	11	4418	December 3, 2020
Crawlers very high? Support	6	958	June 12, 2020