This question is similar to this one: Does Discourse support export conversations as an organized bulk of data? but we are looking for a way to do some NLP on all conversations of our Discourse site. Someone in our team asked if this could be done by acting at some low-level, in the backend, e.g. e…

If you’re self-hosted, then they can do the pg_dump command that they think will help. You can also dump data in various formats with the Data Explorer Plugin .

[image] pfaffman: You can also dump data in various formats with the Data Explorer Plugin So I installed the plugin and looked at all the queries made at (Superseded) What cool data explorer queries have you come up with? but there isn’t anything that can export the actual conversations. For …

SELECT * FROM posts where topic_id=425 That will give you the posts the first topic in your query (given that I can type on this phone). But if what you want is JSON, you could do something like https://meta.discourse.org/t/dump-all-conversations-in-a-file-and-structured-data/202351.json

I didn’t understand your 1st option, maybe a typo in your text? Did you mean I only get the 1st post of the topic? Regarding the 2nd option with the .json extension, is there an alternative url that uses the topic_id or any other entry that can be used to have a more programmatic way to get the con…

Did you try the sql query? Was there an error? Edit: I checked. That query will return all posts in a topic. You can get any topic with only the topic id. https://meta.discourse.org/t/-/202351.json

the query was fine, i just misunderstood your explanation of what it actually provides. Thanks for double-checking. These are great solutions.

Dump all conversations in a file and structured data

Support

Wall-E (Raphael) September 1, 2021, 8:44pm 3

This plugin seems to provide most of what we’re looking for! Thanks!

Topic		Replies	Views
Does Discourse support export conversations as an organized bulk of data? Feature	4	1181	February 21, 2021
Exporting all Topic titles and IDs? Development	1	1611	January 22, 2018
Exporting all Forum Posts for Manual Upload into External LLMs? Support ai	1	374	January 27, 2025
Discourse Public Data Dump Developer Guides	1	1251	May 13, 2025
Saving a Conversation Support	9	1154	November 3, 2021

Dump all conversations in a file and structured data

Related topics