# Sudden Explosion in Crawler Views in 2.0 beta 1

**URL:** https://meta.discourse.org/t/sudden-explosion-in-crawler-views-in-2-0-beta-1/78696
**Category:** Data & reporting
**Created:** [1월 23, 2018, 12:06오전 UTC](https://meta.discourse.org/t/sudden-explosion-in-crawler-views-in-2-0-beta-1/78696 "2018-01-23T00:06:47Z")
**Posts on this page:** 1
**Showing post:** 2

<div class="post-metadata">

### Author: ![Falco](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/falco/32/179432_2.png) [@Falco](https://meta.discourse.org/u/Falco)
#### Post date: [1월 23, 2018, 12:12오전 UTC](https://meta.discourse.org/t/sudden-explosion-in-crawler-views-in-2-0-beta-1/78696/2 "2018-01-23T00:12:38Z")

</div>

> [@RyanK](#):
>
> Did someting change

Yes!

> [@Smarter handling of random crawler traffic](https://meta.discourse.org/t/smarter-handling-of-random-crawler-traffic/78227):
>
> Following: [https://github.com/discourse/discourse/commit/7b562d2f46c60df5323ac06731cf341d95d85027](https://github.com/discourse/discourse/commit/7b562d2f46c60df5323ac06731cf341d95d85027) We now have much improved crawler/bot detection. In the past we have seen many customers complain that pageviews in Google analytics are way off from pageviews in Discourse. This change much more accurately splits up the traffic so both reports are more inline. While analysing this problem I noticed that we are allowing a gigantic amount of crawling from many probably pointless sources. [DotBot](https://moz.com/researchtools/ose/dotbot) …

---

_[View the full topic](https://meta.discourse.org/t/sudden-explosion-in-crawler-views-in-2-0-beta-1/78696)._