If in the Web Crawler User Agents tab
I have the name of the bot, that’s exactly what I have to enter in the options to make sure that the bot is blocked or another name ?
for example
MBCrawler/1.0 (https://monitorbacklinks.com/robot)
then what should be input here
MBCrawler/1.0 or a whole line or maybe any word containing the name of that bot ?
//
2Q
And by the way, are you blocking these bots or not because I read different opinions? Maybe there’s no point in worrying about any bot.
But if so, why is Ahrefs blocked by default, etc . What is the purpose of this?