RGSoC 2016: Visual Forum Analytics Community Discussion

Hey everyone!

I am one of two people who is planing to provide you with informative graphs and charts on user, post etc statistics. We are doing this as our project for Rails Girls Summer of Code and this is our introduction to both open source community and Discourse.

As of now we are familiarising ourselves with Ember, because it is fairly new to us and overall pretty powerful. Boy, Ember is magical indeed!

We’ve already read some threads concerning people’s burning desire for good looking stats (and who can blame them, datavis is the best), but we are open to ideas about how stuff should work and look. Anyways, it is nice meeting you, dev. Hope to have some great time together.

Best,
team kindr3d

17 Likes

Hi Team!

Thanks for posting this! I’m hoping that people in the community can jump in and offer help on various topics.

Visual Forum Analytics is something that a lot of people have wanted for a long time. I’m curious for those in the community what kinds of reports would you like to see? Are there any types of charts you think would be useful?

It’s obviously going to take the team a little while to spin up but I figure now is the best time to ask for ideas :slight_smile:

4 Likes

I was waiting for you to ask :wink:

We are a big company (100K+ employees) and our categories are big parts of the company.

What people are asking is some visual digest per category. They really love the new user summary page, and would like something like that per category.

On my side, I would like that info to be public, since we can’t handle moderation power to the people who handle categories.

1 Like

Yay for visualised stats! :rainbow:

Some parts of this old request might be defunkt now that we’ve got a a first take on visualised stats, but I think many features mentioned there could be a major improvement to what we already have.

Also every metric mentioned here would be great to have visualised:

I just haven’t given much thought yet to the visualisation aspect of these stats. You’re very welcome to drop by that topic and suggest some graph types that you’d think work well for these assorted metrics.

Lastly, does the scope of your project cover adding a new top level /admin/stats page to the backend?

If so then we should eventually have a discussion about the overall design of this “stats index page” as well.


That’s a fair request, and do correct me if I’m wrong @eviltrout, but I think public visualisation of stats is outside the scope of this project. At least, I for one would prefer it if the focus was on figuring out as many cool visualisations of Discourse data as possible. Get the visualisations working and in front of admins, and we can worry about the “how” and “what” of publicly available statistics later.

3 Likes

I don’t know, but I believe what you’re calling Statistics I’ve called Reports.

If so, IMHO it has long deserved it’s own Admin page.

Are we on the same page?

We can continue the “statistics index page” discussion there.

Very similar but not exactly what I had in mind.

That looks like variations of a “one stop page full of stats widgets”

I was thinking more like a Reports “index” page instead of Reports being only reachable via the Dashboard links or known URL(s).

Admittedly, I’d have a hard time designing my way out of a wet framework, but I envision a much more “plain” pragmatic type of dedicated “menu” page. (what most would call boring).

Now thinking about it some configurable page of favorite stat “widgets” would be nice to have and it would surely look better than anything I could design. As I said, I think “features” not “looks”

Yes, I think that’s a fair assessment. One thing to keep in mind is the team is learning A LOT over this process, and so it’s important to start small and build on it from there.

They are going to start with admin reports, adding more as time allows. But if they find that task too easy and have made good progress, maybe they will want to take a look at public reports?

It’s definitely not a priority though :slight_smile:

Honestly the distinction is maybe not as rigid as it seems in this discussion. The project is about taking data from our database and displaying it in a beautiful and easy to understand way.

Some will be extensions of what we already have (reports), and I hope the team will start with this as it’s a good way to learn, but I would not be against having the team generate some smaller “widget” like reports if the visualization makes sense.

4 Likes

When deciding which things to add first, I think it’d be healthy to frame the question in these terms:

Along those lines, one feature to consider adding is a tooltip or explanation that attempts to give some guidance about what a given metric might mean under what scenarios it might be expected to be misleading.

There may be some hints about what kind of data is “missing” in this topic too:

3 Likes

In thinking about our work on calibrating likes notifications, I’d love to have a nice visual statistic on the frequency of different like counts on my forum.

You could adjust the time period, the default being “Likes this month”, and the stat would be:

  • 1 like: 8 posts
  • 2 likes: 4 posts
  • 3 likes: 24 posts
  • 5 likes: 3 posts
  • 6 likes: 0 posts
  • 7 likes: 1 post

and so forth. This data would be super helpful when calibrating your community badges.

1 Like

Hey everyone!

Here are a couple of sketched ideas for the admin dashboard.

This is just our first version, so things will probably change. This is what we think is important for quick overview of stats. Of course we aren’t admins ourselves, so we wanted to share it with the community (with hopes for valuable feedback).

The dashboard consists of 4 components, the admin can switch between three time units: today (last 24 hours), this week and this month. For each component we provide an overall count of new users, new topics etc with comparison (arrow and per cent) with the last time unit and some additional component-specific info.

We are treating those things as modules so the community can improve them later on if the need arises or maybe even build new ones if this info proves to be irrelevant.

We aim for simplicity and clarity and don’t want to over clutter the dashboard. The current dashboard will still continue to exist for more detailed stats.

10 Likes

Neat! Some feedback:

  • Could we add a little :grey_question: tooltip icon or something next to the Today button? This would tell you what timezone “today” is based in. Especially useful for the Visits stat, since my Norwegian “night” might not be the same as meta.discourse.org’s.

  • Visited vs visited&posted is a cool stat to have available at a glance; looking forward to using it! But what does “not visited” mean?

  • The pie chart in the Topics widget is also a bit confusing to me. Maybe it’s just the mix of black/white and actual colour coding that’s throwing me off :stuck_out_tongue: Are those 3 sections in the pie chart connected to the top categories, or are those two separate datasets?


I’ve got tons of different stats I’d like to see, but if I could only pick one, it’d probably have to be this one:

@DeanMarkTaylor already made a query for it.

The stat would be:

Trust Levels Achieved: 34 (up 5%)

  • TL1: 20
  • TL2: 10
  • TL3: 4
  • TL4: 0

We have answers to these (sorta)

  • the time zone question is also a concern of ours. We are not sure, that discourse db has info on user’s time zone, but we think the default is given admin’s timezone and we can maybe have some indication of that on the page. The bar chart for visits is supposed to be adjusted for time zones, we can also just show time slots based on admin’s time instead

  • we wanted to indicate which users are actually active on the forum and logged in today, but maybe the trust level info is more representative, idk, that’s something to think about

  • so the pie chart is basically information on topics’ success (new topics which have no replies, topics with one reply and topics with “many” replies), and this chart is separate from top categories section

And thanks for the feedback. We are really excited to implement this idea.

7 Likes