# Sudden Explosion in Crawler Views in 2.0 beta 1
**URL:** https://meta.discourse.org/t/sudden-explosion-in-crawler-views-in-2-0-beta-1/78696
**Category:** Data & reporting
**Created:** [1월 23, 2018, 12:06오전 UTC](https://meta.discourse.org/t/sudden-explosion-in-crawler-views-in-2-0-beta-1/78696 "2018-01-23T00:06:47Z")
**Posts on this page:** 3
**Page:** 1
### Author:  [@RyanK](https://meta.discourse.org/u/RyanK)
#### Post date: [1월 23, 2018, 12:06오전 UTC](https://meta.discourse.org/t/sudden-explosion-in-crawler-views-in-2-0-beta-1/78696/1 "2018-01-23T00:06:47Z")
Saw a 200+% increase in web crawler PVs (over previous weekly high) despite no other major fluctuations in other areas. Did someting change or could it be a bug in the analytics?
---
### Author:  [@Falco](https://meta.discourse.org/u/Falco)
#### Post date: [1월 23, 2018, 12:12오전 UTC](https://meta.discourse.org/t/sudden-explosion-in-crawler-views-in-2-0-beta-1/78696/2 "2018-01-23T00:12:38Z")
> [@RyanK](#):
>
> Did someting change
Yes!
> [@Smarter handling of random crawler traffic](https://meta.discourse.org/t/smarter-handling-of-random-crawler-traffic/78227):
>
> Following: [https://github.com/discourse/discourse/commit/7b562d2f46c60df5323ac06731cf341d95d85027](https://github.com/discourse/discourse/commit/7b562d2f46c60df5323ac06731cf341d95d85027) We now have much improved crawler/bot detection. In the past we have seen many customers complain that pageviews in Google analytics are way off from pageviews in Discourse. This change much more accurately splits up the traffic so both reports are more inline. While analysing this problem I noticed that we are allowing a gigantic amount of crawling from many probably pointless sources. [DotBot](https://moz.com/researchtools/ose/dotbot) …
---
### Author:  [@JammyDodger](https://meta.discourse.org/u/JammyDodger)
#### Post date: [6월 8, 2024, 12:43오후 UTC](https://meta.discourse.org/t/sudden-explosion-in-crawler-views-in-2-0-beta-1/78696/3 "2024-06-08T12:43:39Z")
이 주제는 2328일 후 자동으로 닫혔습니다. 더 이상 새 답변을 작성할 수 없습니다.