# Import Usenet group?

**URL:** https://meta.discourse.org/t/import-usenet-group/140418
**Category:** Support
**Created:** [February 2, 2020, 11:11pm UTC](https://meta.discourse.org/t/import-usenet-group/140418 "2020-02-02T23:11:58Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![danb35](https://avatars.discourse-cdn.com/v4/letter/d/dfb087/32.png) [@danb35](https://meta.discourse.org/u/danb35)
#### Post date: [February 2, 2020, 11:11pm UTC](https://meta.discourse.org/t/import-usenet-group/140418/1 "2020-02-02T23:11:58Z")

</div>

I’m thinking of setting up a local Discourse instance and importing some Usenet groups into it, just as a matter of having a personal archive of them. I’m not interested in trying to do a two-way mirror, or even necessarily trying to keep up with current topics in those groups (though if it could be readily accomplished I’d be interested in this). What I’m not sure of is how to do it. It looks like I can download messages from some of the groups I’m interested in via Google Groups, though they won’t have full email addresses (I’m not sure if this is going to cause problems in importing the messages)–and some of the other groups just don’t download.

As I think about the question, I realize that I have accounts with a couple of news servers. In principle, it seems it should be pretty straightforward, with the right software, to download all the articles into a .mbox file (or series of files)–but I’m not sure what that software would be. Any suggestions?

Edit: It looks like [slrn](http://slrn.sourceforge.net/) (specifically, slrnpull) can handle the download, though it looks like each post will be in its own file. But I think the .mbox import script can handle that, albeit with a bit of work on the directory structure.

---

<div class="post-metadata">

### Author: ![gerhard](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/gerhard/32/119479_2.png) [@gerhard](https://meta.discourse.org/u/gerhard)
#### Post date: [February 3, 2020, 11:30am UTC](https://meta.discourse.org/t/import-usenet-group/140418/2 "2020-02-03T11:30:48Z")

</div>

> [@danb35](#):
>
> Google Groups, though they won’t have full email addresses

Yeah, that’s going to be a problem, because each message will be assigned to a new, different user. That’s why [Migrate a mailing list to Discourse (mbox, Listserv, Google Groups, etc)](https://meta.discourse.org/t/importing-mailing-lists-mbox-listserv-google-groups-emails/79773) doesn’t allow that by default. You need admin rights on the Google Group to download the full messages including email addresses.

> [@danb35](#):
>
> it looks like each post will be in its own file. But I think the .mbox import script can handle that

Yes, [Migrate a mailing list to Discourse (mbox, Listserv, Google Groups, etc)](https://meta.discourse.org/t/importing-mailing-lists-mbox-listserv-google-groups-emails/79773) works with mbox files as well as each message in it’s own file.

---

<div class="post-metadata">

### Author: ![danb35](https://avatars.discourse-cdn.com/v4/letter/d/dfb087/32.png) [@danb35](https://meta.discourse.org/u/danb35)
#### Post date: [February 3, 2020, 2:11pm UTC](https://meta.discourse.org/t/import-usenet-group/140418/3 "2020-02-03T14:11:55Z")

</div>

> [@gerhard](#):
>
> Yeah, that’s going to be a problem

Thought it might be. Turns out `slrnpull` is **much** faster than the Google Groups download–it’s getting 20-30 messages/second, rather than over a second per message. `import_mbox.sh` is running right now on some of the downloaded data, and so far it’s looking good.

---

<div class="post-metadata">

### Author: ![gerhard](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/gerhard/32/119479_2.png) [@gerhard](https://meta.discourse.org/u/gerhard)
#### Post date: [February 3, 2020, 2:16pm UTC](https://meta.discourse.org/t/import-usenet-group/140418/4 "2020-02-03T14:16:25Z")

</div>

Yeah, if a group is available via NNTP then slrnpull is most likely the better alternative.

---

<div class="post-metadata">

### Author: ![system](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/system/32/443519_2.png) [@system](https://meta.discourse.org/u/system)
#### Post date: [December 25, 2023, 2:10pm UTC](https://meta.discourse.org/t/import-usenet-group/140418/5 "2023-12-25T14:10:51Z")

</div>


