Hello, Is there any plugin to scrab news from other sites ?

There’s: News Plugin 📰 Which uses RSS feeds

The Configure the Discourse RSS Polling Plugin can scrape many sites, like blogs, youtube channels and playlists, and automatically create new topics just a few minutes after content is posted.

I installed the plugin; and follow the guide as below; i put 3 sections to test working rss from bleeping security site; 1st category rss source News in the Security category category filter: none. username selected; and category to post rss selected. second category rss source BleepingComputer category filter: security username selected; and category to post rss selected. also i use another site rss darkreading category filter: vulnerabilities-threats username selected; and category to post rss selected. but nothing work with me ??

Did you go to sidekiq to run the process? If not then it will take a while, depending on your admin settings. Also look in the logs for any errors. You also have to be sure to use an rss url. If you open thise urls they don’t seem to be rss. There is also a setting that makes imported topics unlisted by default.

sorry, i miss that part; the logs show me this [Screenshot at 2022-02-13 17-41-02] [Screenshot at 2022-02-13 17-42-47]

I see now only the third rss (darkreading.com) is working to start posting; and it’s post pretty good more than 100+ post, but all the posts looks like this value: https://www.darkreading.com/rss.xml category filter: vulnerabilities-threats username selected; and category to post rss selected. [Screenshot at 2022-02-13 17-47-22] how can i include full post with pictures ?

[image] f1r4s: how can i include full post with pictures ? Try toggling the embed truncate site setting. [image] f1r4s: also i use another site rss … but nothing work with me ?? Some sites have a weird RSS markup, so you will have to manually debug broken ones.

I recommended using second RSS but the images are broken in scrapping..

Plugin to scrape news from other sites

Product Support

Falco (Falco) February 13, 2022, 5:04pm 19

Try toggling the embed truncate site setting.

Some sites have a weird RSS markup, so you will have to manually debug broken ones.

Topic		Replies	Views
RSS Polling Plugin official , rss-polling , included-in-core	4	18530	August 14, 2026
Import RSS Jenkins Changelog RSS Page Product Support	3	1277	May 28, 2020
Steps to follow to create a (Content Aggregator) plugin, that creates topics from different RSS feeds Development	7	3358	August 31, 2017
Issues with embedding from RSS Product Support	31	3842	June 26, 2020
Discourse News Aggregator Plugin Product Support	5	2286	September 7, 2019

Plugin to scrape news from other sites

Related topics