eextra
(Sylwia)
February 29, 2020, 11:16am
1
If in the Web Crawler User Agents tab
I have the name of the bot, that’s exactly what I have to enter in the options to make sure that the bot is blocked or another name ?
for example
MBCrawler/1.0 (https://monitorbacklinks.com/robot)
then what should be input here
MBCrawler/1.0 or a whole line or maybe any word containing the name of that bot ?
//
2Q
And by the way, are you blocking these bots or not because I read different opinions? Maybe there’s no point in worrying about any bot.
But if so, why is Ahrefs blocked by default, etc . What is the purpose of this?
1 Like
I think monitorbacklinks
would be best as it is the longest unique string.
2 Likes
Hello Sylwia, and thank you for adding this post.
Do you know what the SEO implications of blocking bots from google may be?
Did you get a response to your second question:
eextra:
2Q
And by the way, are you blocking these bots or not because I read different opinions? Maybe there’s no point in worrying about any bot.
But if so, why is Ahrefs blocked by default, etc . What is the purpose of this?
I am in the process of blocking bots to keep my pageviews under control and within by subscription plan.
1 Like