You can see detailed numbers on a per-crawler basis if you visit
your.site.com/admin/reports/web_crawlers
If you see an unusual crawler that’s misbehaving, you can add a unique string from its user agent to the blacklisted_crawler_user_agents setting and it will be blocked.