Name of blacklisted user agent

Product Support

AI-generated summary

The discussion revolves around blocking user agents, specifically bots, in the Web Crawler User Agents tab. eextra asks about the correct format to enter for blocking bots, citing the example MBCrawler/1.0 (https://monitorbacklinks.com/robot). codinghorror suggests using the longest unique string, such as monitorbacklinks.

eextra also questions the effectiveness of blocking bots, mentioning different opinions on the matter. Emilio_F_Castillo responds by asking about the SEO implications of blocking Google bots and inquiring about the purpose of blocking certain bots by default, such as Ahrefs. Emilio_F_Castillo is blocking bots to control pageviews and stay within their subscription plan.

1

If in the Web Crawler User Agents tab
I have the name of the bot, that’s exactly what I have to enter in the options to make sure that the bot is blocked or another name ?

for example
MBCrawler/1.0 (https://monitorbacklinks.com/robot)

then what should be input here

image
image747×172 17.2 KB

MBCrawler/1.0 or a whole line or maybe any word containing the name of that bot ?

//

2Q
And by the way, are you blocking these bots or not because I read different opinions? Maybe there’s no point in worrying about any bot.

But if so, why is Ahrefs blocked by default, etc . What is the purpose of this?

2

I think monitorbacklinks would be best as it is the longest unique string.

3

Hello Sylwia, and thank you for adding this post.

  1. Do you know what the SEO implications of blocking bots from google may be?
  2. Did you get a response to your second question:

I am in the process of blocking bots to keep my pageviews under control and within by subscription plan.