Well right now I’m fighting with this “bots” …
OMG, why so many pageviews from bots!
I’ve already read this: How to block all crawlers but Google's
But… I’m in trouble here… is it ok to block “all” crawlers (except Google bot) ?
Well right now I’m fighting with this “bots” …
I’ve already read this: How to block all crawlers but Google's
But… I’m in trouble here… is it ok to block “all” crawlers (except Google bot) ?