I found this thread from 2018-2020 where bingbot was found to be crawling at very high rates.
I am seeing this on our site, but not sure how long this has been an issue.
In the screenshot below, the rankings are as follows.
- Bingbot (mobile)
- Site monitor
- Some image bot
Google accounts for 10x+ the incoming traffic of Bing, while using just ~12% of the crawler hits.
Anyone else seeing similar stats?
For now, I have added bingbot to the
slow down crawler user agents list.