The discussion centers on implementing a public data export feature for Discourse, similar to Stack Exchange’s public dumps, which would sanitize private user data and offer exports in JSON and HTML formats. Proposed benefits include enabling CC-licensed content redistribution, increasing user trust by ensuring content longevity, and supporting data analysis. While some users like obvio171 and samwilson strongly support the idea, codinghorror suggests prioritizing the individual download button first. tobiaseigen proposes integrating filtering options (by user, topic, or keyword) into the export tool. EricGT highlights growing interest in using Discourse data for AI training, noting that while admins can manually sanitize backups, a standardized export tool would be preferable. As of Falco, this feature is now on the roadmap for Discourse’s AI team, signaling active development. EricGT expresses optimism about Discourse’s direction amid broader AI trends.
I’d like to propose a public data export feature similar to Stack Exchange’s. This is not the same as the backup feature, because it requires sanitizing all private user data first. Both JSON and HTML export formats would be great.
This is useful for:
CC-licensed content to be made available more easily
users to feel more comfortable knowing that the site can’t suddenly disappear with all their content
Maybe these are related. E.g. the functionality provides filtering options during the export process. Export content from these users, these topics, these keywords etc.