Hi, I would like to open a new thread to continue the discussion here about an importer for Google Groups. In short, I have a simple python scripts based on Scrapy that scraps all messages of a group to a JSON file. I hope someone who knows Ruby and Discourse API could make it into a real importer …

Alright, I figured it out and I hope this could help others. I’m using GitHub - icy/google-group-crawler: [Deprecated] Get (almost) original messages from google group archives. Your data is yours. · GitHub with the latest version (b42f28d4c36eddce1df039566f3615b0753a2dc6) of mbox import script. C…

[image] steinwaywhw: BTW, “New users can only have two links in a post” - why is that? it’s annoying. Its a spam protection measure, you can disable in site settings, on import you generally bypass all validation so this should not be an issue for import.

You are right. I just realized spams are all about posting links.

Those are really helpful. Thanks a lot and i will take time learn some new skills :slight_smile:

Did you look into either of these projects? GitHub - icy/google-group-crawler: [Deprecated] Get (almost) original messages from google group archives. Your data is yours. · GitHub GitHub - henryk/gggd: Get Google Groups Data – Tool to fetch all messages of a Google Group as raw mbox data · GitHub …

Thanks for the pointers. I think it largely works, but the mbox importer has some null pointer exceptions at discourse/script/import_scripts/mbox.rb at main · discourse/discourse · GitHub and discourse/script/import_scripts/base.rb at main · discourse/discourse · GitHub . It seems that the connection…

An Importer for Google Groups

Product Support

mcwumbly (Dave McClure) June 14, 2016, 2:19am 3

If you want to check out a couple examples of importers that use JSON files as the starting point, there are at least a few precedents:

Ning
Quandora
Socialcast (In Progress)

Topic		Replies	Views
Import Usenet group? Product Support	3	1145	February 3, 2020
Migrate a mailing list to Discourse (mbox, Listserv, Google Groups, etc) Migrating to Discourse how-to	109	27199	April 3, 2026
Importing HTML into Discourse Migration	1	515	October 29, 2023
Migration from Yahoo! Groups Migration	23	7108	November 4, 2019
Forwarding new posts from googlegroup to Discourse Product Support	14	2963	October 28, 2019

An Importer for Google Groups

Related topics