If in the Web Crawler User Agents tab I have the name of the bot, that’s exactly what I have to enter in the options to make sure that the bot is blocked or another name ? for example MBCrawler/1.0 (https://monitorbacklinks.com/robot) then what should be input here [image] MBCrawler/1.0 or a…

Hello Sylwia, and thank you for adding this post. Do you know what the SEO implications of blocking bots from google may be? Did you get a response to your second question: [image] eextra: 2Q And by the way, are you blocking these bots or not because I read different opinions? Maybe there’s …

Name of blacklisted user agent

Product Support

codinghorror (Jeff Atwood) February 29, 2020, 8:23pm 2

I think monitorbacklinks would be best as it is the longest unique string.

Topic		Replies	Views
Crawler-mania - what happened there? Product Support	2	589	January 18, 2021
Web Crawlers Data & reporting	11	1428	July 31, 2023
Throttling user agents and settings format Product Support	3	930	October 18, 2018
Why semrushbot and ahrefsbot are blocked by default? Product Support	10	4706	December 3, 2020
Crawlers very high? Product Support	5	1097	May 13, 2020

Name of blacklisted user agent

Related topics