I am looking to build a archive for a mailing list. I imagine a thread to become a topic, email addresses being replaced with usernames if a matching account exists. Can the Email-In feature be used to “ingest” a mailing list this way?

I do this on my forum. The key requirement is that all emails arriving from your mailing list have a consistent from address. From memory, the rough process we followed was: We have a mailman list on another server which sends email from “mailing-list@example.com”. Temporarily enabled “staged users” so that an account would automatically be created without a confirmation email We set up a category “mailing list archive” on Discourse, and set the incoming email address to “forum-archive@forum.example.com” We added “forum-archive@forum.example.com” as a recipient of the mailing list When an email was sent, a staged user was created on Discourse with the email address “mailing-list@example.com”. We then changed the profile pic & username on the user as needed Disabled “staged users” We actually did this for 5-6 different mailing lists, so we have a number of “archive” categories on the forum.

It works, but you’ll need to change a few email related site settings for this to work. But, I’m currently working on a feature that will allow you to configure a category as a mailinglist mirror, which will make things a lot easier and more secure. The new category setting allows incoming emails to be auto-generated even when block_auto_generated_emails is enabled in Site Settings allows finding related posts by Message-ID even when find_related_post_with_key is enabled in Site Settings always uses the email cook method for incoming emails (currently all incoming emails use the regular cook method which interprets Markdown) prevents sending of rejection emails (we don’t want to annoy any mailinglist users when Discourse rejects an email for whatever reason)

Right now, I’m struggling with the Email-In feature with a mailman mailing list. I’ve set up an email account as a subscriber to the mailing list, and the Discourse category checks that address. But everything is rejecting. Can this new feature be set to check for “list@domain.com” as a recipient (To: or CC:) of the e-mail? Right now, I get a lot of errors like: We’re sorry, but your email message to [“foo@bar.com”] (titled Re: [forum] Email-Subject) didn’t work. None of the destination email addresses are recognized, or the Message-ID header in the email has been modified. Please make sure that you are sending to the correct email address provided by staff.

You need to make the following configuration changes if you want it to work right now: Site Settings enable reply by email enabled enable email in disable find related post with key depending on your mailinglist, disable block auto generated emails Category set the Custom incoming email address to list@example.com enable Accept emails from anonymous users with no accounts

a solution to ingest and transit an existing mailman installation would really be a VERY interesting solution for a lot of people who kept their stuff with mailing for the last decade(s) and stayed mostly because there is no good transition method. (but many are unhappy, especially since lists scare away lot’s of potential new users.)

[image] adorfer: ingest and transit an existing mailman installation There is already an MBOX importer. I seem to remember that mailman’s storage format isn’t quite MBOX compliant, but you can certainly convert it to MBOX easily. Then follow the instructions here: [image] (Superseded) Import MBOX (mailing list) files packageMigrating to Discourse warning This Howto is out-of-date. Please check out Migrate a mailing list to Discourse (mbox, Listserv, Google Groups, etc) for updated instructions. Want to move your mailing list archive to Discourse? Let’s do it! Prerequisites Not everything that writes MBOX files plays by the same rules. You will likely need to do some programming to get your import to work just right. This script should import most of your data, but unless you are very lucky, getting every bit of it will take a … Migration from mailing list systems like mailman is one of Discourse’s key selling points

This may be a good solution for many of the people involved in discourse and/or ruby for a while. But for starters “condering” if the like such a migration, this might be a barrier. off course it’s feasable, but a more “multi step web ui importer” would be an even more attractive solution. Especially some regex-magic on “cutting footers”, “killing excessive quoting” would stop people from reinventing the wheel. (i can still setup sendmail by m4, and remember the qmail documentation. nevertheless, i appreciate convenient solutions nowadays too.)

@gerhard It looks like the feature you were talking about in Can Email-In be used to "ingest" a mailing list? - #3 by gerhard has landed (there is now a “Category mirrors a mailing list” tick box on the category). Does this change the list of things to set in Can Email-In be used to "ingest" a mailing list? - #5 by gerhard ?

Can Email-In be used to "ingest" a mailing list?

Product Support

gerhard (Gerhard Schlager) August 5, 2019, 9:34am 10

Yes, that feature has landed. You can read more about it in Mirroring a read-only mailing list in Discourse.

Topic		Replies	Views
Continuing to run Mailman and Discourse using the exact email addresses (as Mailman) in parallel Migration	5	1700	February 11, 2022
Mirroring a read-only mailing list in Discourse Site Management how-to	12	8539	April 29, 2025
Replacing Mailing lists: Email-In Feature	66	18154	October 4, 2014
HOWTO migrate from mailman2 to discourse Product Support	1	1370	June 12, 2021
Admin Interface and capabilities Self-hosting	3	1964	November 13, 2018

Can Email-In be used to "ingest" a mailing list?

Related topics