I’m thinking of setting up a local Discourse instance and importing some Usenet groups into it, just as a matter of having a personal archive of them. I’m not interested in trying to do a two-way mirror, or even necessarily trying to keep up with current topics in those groups (though if it could be readily accomplished I’d be interested in this). What I’m not sure of is how to do it. It looks like I can download messages from some of the groups I’m interested in via Google Groups, though they won’t have full email addresses (I’m not sure if this is going to cause problems in importing the messages)–and some of the other groups just don’t download. As I think about the question, I realize that I have accounts with a couple of news servers. In principle, it seems it should be pretty straightforward, with the right software, to download all the articles into a .mbox file (or series of files)–but I’m not sure what that software would be. Any suggestions? Edit: It looks like slrn (specifically, slrnpull) can handle the download, though it looks like each post will be in its own file. But I think the .mbox import script can handle that, albeit with a bit of work on the directory structure.

[image] danb35: Google Groups, though they won’t have full email addresses Yeah, that’s going to be a problem, because each message will be assigned to a new, different user. That’s why Migrate a mailing list to Discourse (mbox, Listserv, Google Groups, etc) doesn’t allow that by default. You need admin rights on the Google Group to download the full messages including email addresses. [image] danb35: it looks like each post will be in its own file. But I think the .mbox import script can handle that Yes, Migrate a mailing list to Discourse (mbox, Listserv, Google Groups, etc) works with mbox files as well as each message in it’s own file.

[image] gerhard: Yeah, that’s going to be a problem Thought it might be. Turns out slrnpull is much faster than the Google Groups download–it’s getting 20-30 messages/second, rather than over a second per message. import_mbox.sh is running right now on some of the downloaded data, and so far it’s looking good.

Import Usenet group?

Product Support

gerhard (Gerhard Schlager) February 3, 2020, 2:16pm 4

Yeah, if a group is available via NNTP then slrnpull is most likely the better alternative.

Topic		Replies	Views
An Importer for Google Groups Product Support	7	7279	June 14, 2016
Forwarding new posts from googlegroup to Discourse Product Support	14	3013	October 28, 2019
How to migrate from Yahoo groups to Discourse Migration	0	3781	November 5, 2019
Migration from Yahoo! Groups Migration	23	7276	November 4, 2019
Migrate a mailing list to Discourse (mbox, Listserv, Google Groups, etc) Migrating to Discourse how-to	109	27622	April 3, 2026

Import Usenet group?

Related topics