Not sure if this really relates to the consolidated view or a more basic issue, but I’m seeing the stats claim a lot of “anonymous user” page views on my site, which ONLY permits access by logged-in users. Other than pages like privacy policy, TOS, etc. which I’d like to block from non-logged in users (but can’t in Discourse currently), no other pages are accessible at all unless you’re logged in. The crawler count is similarly suspect, but with a much smaller actual count.
AI-generated summary
In this discussion on Consolidated Pageviews accuracy, users express confusion over inflated “anonymous user” and “logged in users” pageview metrics on Discourse sites restricted to logged-in users. L30110 and Alexander_Wright question high crawler and anonymous stats despite login-only access, with j.jaffeux clarifying that public pages like /login remain accessible. 10ColorsTenkara and meglio initially misinterpret “logged in users” as unique users rather than pageviews, corrected by Falco and fzngagan. TheBestPessimist suggests clearer labels like “from Anonymous cowards” for better intuition, met with lighthearted agreement from codinghorror. pfaffman reports 80K daily crawler hits, later traced to HAProxy keep-alive requests; j.jaffeux advises blacklisting via user-agent, though pfaffman notes uptime tools and HAProxy may lack user-agent headers. codinghorror emphasizes that omitting user-agent is poor practice. The thread concludes with users understanding the metrics better and seeking ways to exclude legitimate health checks from stats without blocking access.
It’s not related to the new report which is using the same data you can find in other reports for a long time.
Concerning other questions:
What’s your basis to consider it suspect?
Even if only logged in, as you said some pages are still accessible as you said, especially /login. Can’t tell you exactly what’s going on with your instance with no data, but this is what I see on a similar instance:
That is Logged in users PAGEVIEWS, as one user can have hundreds of pageviews in one day.
Cheers.
That’s what I get for not reading carefully enough. Stupid mistake on my part.
Apparently that text is not that intuitive.
Would
from Crawlers
from Logged in users
from Anonymous cowards
look simpler to understand @10ColorsTenkara and @L30110 ?
Why, I never! How dare you sir! ![]()
After a lot of years, that title still makes me giggle a little ![]()
Yes, I like that. Good suggestion.
Very likely yes. Run the crawler report in Admin, Reports to see details: /admin/reports/web_crawlers
Mystery solved. The ops team put an uptime checker on the site:
LogicMonitor SiteMonitor/1.0: 50339
On a login-required site that I manage I’m getting ~80K crawlers per day.
I noticed that sometime in late September traffic jumped significantly and have wondered what the explanation was
I suppose I should go look at the NGINX logs and see if I can figure out what the heck is hitting the site 80K times a day.
Did you look at the report jeff linked 2 posts before yours ?
Oh. Golly. No, I had not noticed. ![]()
Oh! It’s not uptime robot (that’d be just 24 * 60 = 1440), but Haproxy doing a http-keep-alive. But
24 hours * 60 minutes * 2 instances * 2/minute is only 5760, which is a far cry from 80K. The Web Crawler page for yesterday and today shows 140K requests from -.
OK. (* 24 60 60) is 86400, so that’s what’s happening.
I don’t see how haproxy is making that many requests, but maybe that’s because I don’t know what I’m doing.
Is there a way to filter those? E.g., not count requests from a certain IP?
We allow blacklisting through user agent: /admin/site_settings/category/all_results?filter=crawler
Ah! That’s a start, but it seems that neither haproxy nor uptime robot is sending a User Agent (?). And if I were to blacklist them, they’d not be able to access, right?
I want haproxy and uptime robot to be able to see that the site is up without counting their checks as page views.
Everyone should be sending a user-agent.. so if they aren’t, that’s not just a bug but kinda designing for evil.
This is what it is. Not the number of logged in users that day.





