# "Daily updates" option for mailing list mode

**URL:** <https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029>\
**Category:** Feature\
**Created:** [2016年五月31日 10:51 UTC](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029 "2016-05-31T10:51:01Z")\
**Posts on this page:** 20\
**Page:** 2

<div class="post-metadata">

**Author:** ![fefrei](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/fefrei/32/119538_2.png) [@fefrei](https://meta.discourse.org/u/fefrei)\
**Post date:** [2017年五月3日 14:46 UTC](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029/21 "2017-05-03T14:46:50Z")

</div>

> [@sam](#):
>
> Do you need the fancy HTML styling there?

Yes, that’s how “normal users” read emails 😉

> [@sam](#):
>
> Do you see any value in an email containing 1000 posts in a batch?

No. But if you pull this feature now, my students cannot get these daily updates anymore, which max out at about 5 posts and are incredibly useful…

---

<div class="post-metadata">

**Author:** ![sam](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/sam/32/102149_2.png) [@sam](https://meta.discourse.org/u/sam)\
**Post date:** [2017年五月3日 14:51 UTC](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029/22 "2017-05-03T14:51:11Z")

</div>

I am not adding this back in as is, if someone wants to build a “25 email batch thing with min of 1 email daily” option for mailing list mode I am fine.

But this… no.

---

<div class="post-metadata">

**Author:** ![fefrei](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/fefrei/32/119538_2.png) [@fefrei](https://meta.discourse.org/u/fefrei)\
**Post date:** [2017年五月3日 14:53 UTC](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029/23 "2017-05-03T14:53:07Z")

</div>

Ouch, this sucks.

What will the migration do for existing users with this option enabled?

---

<div class="post-metadata">

**Author:** ![sam](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/sam/32/102149_2.png) [@sam](https://meta.discourse.org/u/sam)\
**Post date:** [2017年五月3日 14:54 UTC](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029/24 "2017-05-03T14:54:18Z")

</div>

Flick it to nothing and enable daily summary instead.

---

<div class="post-metadata">

**Author:** ![alehandrof](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/alehandrof/32/119526_2.png) [@alehandrof](https://meta.discourse.org/u/alehandrof)\
**Post date:** [2017年五月3日 14:57 UTC](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029/25 "2017-05-03T14:57:02Z")

</div>

Gosh. What’s the latest beta that doesn’t include this change? Is it this one?  
[Release v1.8.0.beta11 · discourse/discourse · GitHub](https://github.com/discourse/discourse/releases/tag/v1.8.0.beta11)

---

<div class="post-metadata">

**Author:** ![sam](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/sam/32/102149_2.png) [@sam](https://meta.discourse.org/u/sam)\
**Post date:** [2017年五月3日 15:23 UTC](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029/26 "2017-05-03T15:23:16Z")

</div>

We have not rolled this back yet, so whatever is latest beta and stable has it.

We are open to funding @gdpelican to extract this into a plugin so its not lost forever in the ether.

Fixing this is a fairly complicated task to do efficiently, cause the pipeline needs to trigger a bulk check on every user with “daily and batched” enabled for every post created. We may also need to add indexes tracking columns.

---

<div class="post-metadata">

**Author:** ![alehandrof](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/alehandrof/32/119526_2.png) [@alehandrof](https://meta.discourse.org/u/alehandrof)\
**Post date:** [2017年五月3日 15:39 UTC](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029/27 "2017-05-03T15:39:09Z")

</div>

As a non-hosted customer, the difference between core and plugin is immaterial – as long as the plugin is maintained going forward.

When we switched over to Discourse in March of last year, a “daily digest” was the most requested feature from our members. Unfortunately, it wasn’t ready yet at the time of our annual get-together. (Or it had just been and I hadn’t noticed, I forget which.)

This year I’d ❤ to be able to get everyone onboard the “daily updates” train, take on the inevitable attrition, and work at invigorating our community.

In other words, I would be a very happy puppy indeed if I knew what the outlook of this feature looks like in the next two weeks 😉

---

<div class="post-metadata">

**Author:** ![tobiaseigen](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/tobiaseigen/32/539204_2.png) [@tobiaseigen](https://meta.discourse.org/u/tobiaseigen)\
**Post date:** [2017年五月3日 16:14 UTC](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029/28 "2017-05-03T16:14:04Z")

</div>

Could you help with a database explorer query to see who’s got daily updates turned on now, before we upgrade? Then we can reach out to those users directly to let them know of the change.

FWIW I support this change. Thanks, @sam!

---

<div class="post-metadata">

**Author:** ![tgxworld](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/tgxworld/32/106117_2.png) [@tgxworld](https://meta.discourse.org/u/tgxworld)\
**Post date:** [2017年五月4日 09:21 UTC](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029/29 "2017-05-04T09:21:54Z")

</div>

> [@mcwumbly](#):
>
> There’s a lot in there.  
> There’s a lot in there… really… and Gmail clips the message because I guess it’s too big?

I’ve have not been following this discussion until recently where I had to hunt down a Sidekiq job that was hogging alot of memory. I’ll like to reiterate that **there is alot in there** XD On one of our largest site, the PDF for the email is 268 A4 pages long. I don’t see how that can be useful for anyone.

---

<div class="post-metadata">

**Author:** ![mcwumbly](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/mcwumbly/32/103861_2.png) [@mcwumbly](https://meta.discourse.org/u/mcwumbly)\
**Post date:** [2017年五月4日 09:32 UTC](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029/30 "2017-05-04T09:32:23Z")

</div>

> [@sam](#):
>
> Fixing this is a fairly complicated task to do efficiently,

Rather than pull this completely or hold out for a proper batching strategy, what if something simpler were done first?

Maybe we could just add a sane, hard upper limit on the number of messages that could be included in the daily digest (eg 50 messages). If the number is exceeded, it could just say so transparently and tell people to visit the site to see the other messages.

That way, it stays useful for forums that usually stay under the limit and effectively removes itself for busier forums where it is too expensive and makes no sense as a feature.

---

<div class="post-metadata">

**Author:** ![gdpelican](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/gdpelican/32/81308_2.png) [@gdpelican](https://meta.discourse.org/u/gdpelican)\
**Post date:** [2017年五月4日 10:55 UTC](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029/31 "2017-05-04T10:55:28Z")

</div>

Cool; I kinda knew this writing it, but figured we’d be able to iterate on it at some point; fwiw I think it makes way more sense to simply cap the amount of content which can go in and point users at the site to read the rest, rather than entirely pulling a feature that folks are using.

I’m fully committed until the last few days of May, but it’s not much work to convert this to a plugin and could likely have it done by end of month, so there wouldn’t be too much of a gap between when it’s not available and when it is.

---

<div class="post-metadata">

**Author:** ![tgxworld](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/tgxworld/32/106117_2.png) [@tgxworld](https://meta.discourse.org/u/tgxworld)\
**Post date:** [2017年五月4日 13:55 UTC](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029/32 "2017-05-04T13:55:32Z")

</div>

> [@mcwumbly](#):
>
> Maybe we could just add a sane, hard upper limit on the number of messages that could be included in the daily digest (eg 50 messages). If the number is exceeded, it could just say so transparently and tell people to visit the site to see the other messages.

Having a limit is not enough here 💭 We’ll also need to truncate posts that are too long or have too many images. Also, there has to be some rule in deciding which posts to show. Is it going to be the 50 latest messages or the 50 most popular messages?

I’m having trouble understanding the use case for this though. For a really large forum, the daily update is so huge that it isn’t even useful at all. For small forums, perhaps sending an email for each post might be a good replacement and won’t be too spammy since activity is much lower on smaller sites.

---

<div class="post-metadata">

**Author:** ![mcwumbly](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/mcwumbly/32/103861_2.png) [@mcwumbly](https://meta.discourse.org/u/mcwumbly)\
**Post date:** [2017年五月4日 14:12 UTC](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029/33 "2017-05-04T14:12:51Z")

</div>

> [@tgxworld](#):
>
> We’ll also need to truncate posts that are too long or have too many images.

Really? And if so, isn’t that an issue for a batch size of 1 as well?

> [@tgxworld](#):
>
> Is it going to be the 50 latest messages or the 50 most popular messages?

If it were me I’d pick something easy to “stop the bleeding” and then think about this more later if it deserved more thought.

> [@tgxworld](#):
>
> For small forums, perhaps sending an email for each post might be a good replacement and won’t be too spammy since activity is much lower on smaller sites.

I don’t have a horse in this race myself. I’m just judging from the initial feedback that others may already be finding it useful. Would have to dive deeper with them to really understand whether it’s providing any value.

---

<div class="post-metadata">

**Author:** ![sam](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/sam/32/102149_2.png) [@sam](https://meta.discourse.org/u/sam)\
**Post date:** [2017年五月4日 14:28 UTC](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029/34 "2017-05-04T14:28:36Z")

</div>

> [@mcwumbly](#):
>
> Really? And if so, isn’t that an issue for a batch size of 1 as well?

To a lesser degree yes, but at batch size 50 it becomes 50x the problem.

> [@mcwumbly](#):
>
> If it were me I’d pick something easy to “stop the bleeding” and then think about this more later if it deserved more thought.

The way stuff is selected here makes it tricky to place a limit, sure we can fix it and pick something random and add a “oops too much” string. But we already spent **1 week of engineering** debugging this problem. I am concerned that even at batch size of 25 or 50 we can see bloat due to Nokogiri (our html parser) working through the largest document we ever work through in the system.

> [@mcwumbly](#):
>
> I’m just judging from the initial feedback that others may already be finding it useful.

I totally get that @alehandrof and @fefrei love the feature and want it, but I am thinking of the greater good here and we simply can not ship this feature as is even with limits.

---

<div class="post-metadata">

**Author:** ![fefrei](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/fefrei/32/119538_2.png) [@fefrei](https://meta.discourse.org/u/fefrei)\
**Post date:** [2017年五月4日 19:32 UTC](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029/35 "2017-05-04T19:32:22Z")

</div>

A small hint for anyone preparing for the fallout: You may want to enable the option to include posts by TL0 users in digests. To do so…

1. enable the site setting `default include tl0 in digests` to catch new users
2. `./launcher enter app`
3. `rails c`
4. `User.all.each { |u| uo = u.user_option ; uo.include_tl0_in_digests = true; uo.save! }`

You may also want to increase the `digest posts` setting.

This will flip the switch on for all new and existing users. (It will not affect the digest frequency and whether the digest is enabled, but that should be migrated automatically as per @sam.)

---

<div class="post-metadata">

**Author:** ![watchmanmonitor](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/watchmanmonitor/32/430970_2.png) [@watchmanmonitor](https://meta.discourse.org/u/watchmanmonitor)\
**Post date:** [2017年五月5日 02:48 UTC](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029/36 "2017-05-05T02:48:58Z")

</div>

Because I was mentioned..

> [@alehandrof](#):
>
> What notifications do they suggest for their users?

I’m interested in any topic relating to the email side of forums, but I’m not looking for a daily updates as a default feature. It would be redundant to what I think is best for the member-only discussion boards I run.

I feel that Discourse administrators should be able to set defaults so that:

- All new users should have key categories set to Watching.
  - This applies to all existing topics in the category.

- Every user should have a simple way to opt-out of any given topic.
- Opting out of a topic should look quite different than opting out of the entire forum.
- When a user visits their profile page, it should be simple to switch to daily digest if they chose, however:
- Replies to daily digest emails should not post to any given topic.

So, no I won’t be sad to see this feature go. Historically, people try to reply to messages like these & those replies don’t work.

---

<div class="post-metadata">

**Author:** ![alehandrof](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/alehandrof/32/119526_2.png) [@alehandrof](https://meta.discourse.org/u/alehandrof)\
**Post date:** [2017年五月5日 08:09 UTC](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029/37 "2017-05-05T08:09:19Z")

</div>

Allen, I mistakenly remembered that you were interested in this feature. Sorry about that! I do appreciate your taking the time to respond.

I’m confused, though, because you mention that you won’t be sad to see this feature go, but also (your third point) that users should be able to use it.

The discussion above is not on making the daily digest the default option or not, but on whether it should be a feature at all, given the issues it creates for larger/busier forums.

Edit: hopefully the idea of spinning it out as plugin pans out. That would be fine for my needs, until a better alternative can be put in place.

---

<div class="post-metadata">

**Author:** ![watchmanmonitor](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/watchmanmonitor/32/430970_2.png) [@watchmanmonitor](https://meta.discourse.org/u/watchmanmonitor)\
**Post date:** [2017年五月5日 19:31 UTC](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029/38 "2017-05-05T19:31:32Z")

</div>

I’m with Sam, I feel that the Activity Summaries are good enough. If someone doesn’t want every email, then I don’t know that they’re going to read them all in a full digest anyway.

If they care to read every message, all they need to do is follow a summary email link to Discourse, and once online they’ll have a live view of everything that’s unread/new since their last visit.

---

<div class="post-metadata">

**Author:** ![alehandrof](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/alehandrof/32/119526_2.png) [@alehandrof](https://meta.discourse.org/u/alehandrof)\
**Post date:** [2017年五月24日 11:00 UTC](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029/39 "2017-05-24T11:00:19Z")

</div>

Can you or @sam suggest how I can set the following settings for all users (via the console):

 ![](https://global.discourse-cdn.com/meta/original/3X/a/0/a06b6d9c2abbfa549a38cdefd12f89a8d9235af0.png)

I realize that some of these will be taken care of automatically if I upgrade, but I don’t want to do this yet as I got pushback from my community about dropping the daily digest. I’d like to try out a more frequent activity summary though before deciding, though.

---

<div class="post-metadata">

**Author:** ![fefrei](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/fefrei/32/119538_2.png) [@fefrei](https://meta.discourse.org/u/fefrei)\
**Post date:** [2017年五月24日 11:02 UTC](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029/40 "2017-05-24T11:02:45Z")

</div>

The first checkbox is taken care of by what I posted above, the rest should be an easy extension 🙂

[上一頁](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029.md?page=1)

[下一頁](https://meta.discourse.org/t/daily-updates-option-for-mailing-list-mode/45029.md?page=3)
