Name of blacklisted user agent

If in the Web Crawler User Agents tab
I have the name of the bot, that’s exactly what I have to enter in the options to make sure that the bot is blocked or another name ?

for example
MBCrawler/1.0 (

then what should be input here

MBCrawler/1.0 or a whole line or maybe any word containing the name of that bot ?


And by the way, are you blocking these bots or not because I read different opinions? Maybe there’s no point in worrying about any bot.

But if so, why is Ahrefs blocked by default, etc . What is the purpose of this?

I think monitorbacklinks would be best as it is the longest unique string.

1 Like