Поиск альтернативы AdSense

[JimPas]

Попробуйте эти два способа, опубликованные @awesomerobot. Второй метод должен решить проблему для вас. (Это напомнило мне добавить ещё пару пунктов в мой список blocked crawler user agents.)

Seeing anonymous user and crawler traffic, even though site is private

There shouldn’t be anything additional you need to do… that crawler traffic is likely from crawlers hitting community.yoursite.com/login. If you check community.example.com/admin/reports/web_crawlers you can see how often specific crawlers are hitting your site. There are a couple things you can do to reduce the crawler traffic… Try disallowing /login from crawlers within robots.txt (community.example.com/admin/customize/robots)… you’d probably see some crawler traffic drop (though probably …