Yes, of course, I forgot to clarify that I am doing this cleaning management; crawler by crawler, almost weekly analysis to detect which one is the most invading the website, and I block it one by one.
What I’m afraid of is that adding so many bots to the blacklist will somehow affect the performance of the site.
So I thought that maybe instead of blocking one by one, the best thing could be to add the essential bots to the whitelist and block all the others. But … essential trackers, do they exist?
I searched the forum to see if there is a debate “dedicated” to essential crawlers but I could not find it. If you know of a topic related to this, please let me know.