We want to build an automated pipeline that that can update the discourse custom theme what we built which has different tabs for different kind of scrapped data content: Scrapes content from sources (RSS feeds, websites, etc.) Structures the data with metadata: title, source, type (news/conferenc…

Maybe have a look at RSS Polling

Thanks pfaffman for the plugin suggestions. However, we don’t have rss feed data, we are storing scrapped data into standalone database..can we use this plugin to connect to the standalone database and fetch the needed data and render the content

It was an example. You could either make your scaped data into an rss feed or modify the plugin to read whatever format you want to put it in. What I would probably do is write the scraper in ruby and integrate it into a plugin. Or maybe Use the Discourse API ruby gem and put it in a Github action…

Thanks Jay. Already scrapper development is completed with python …now we were evaluating how to render this scrapped data which is stored in monodb.

Discourseのカスタムタブベースのテーマを持つカテゴリへスクレイピングデータを投稿するパイプライン構築のベストな方法

サポート

pfaffman (Jay Pfaffman) 2025 年 3 月 26 日午後 9:40 3

RSS Polling を参照してください

トピック		返信	表示
Share your use cases of using Discourse REST API 🧑‍💻 Development rest-api	2	837	2023 年 8 月 8 日
API / Functionality required to push Data from Discourse to external resource Development	6	679	2024 年 2 月 4 日
Automating Discourse Topic Creation Extras	4	353	2024 年 12 月 14 日
Do you have original customisations? Community Building	9	2842	2018 年 4 月 2 日
Rss feed to topics or posts in Discourse based forums Feature	9	3283	2022 年 9 月 11 日

Discourseのカスタムタブベースのテーマを持つカテゴリへスクレイピングデータを投稿するパイプライン構築のベストな方法

関連トピック