>
> Previously, \`ImportedTopics\` matched every feed item URL in a single \`embed\_url …~\* ANY(ARRAY\[...\])\` query. Postgres only caches 32 compiled regexes, so with more patterns it recompiles them for every row it checks. With \`rss\_polling\_update\_tags\` disabled, a 1,600-item feed took ~25 minutes per poll on a site with 100k embeds.
>
> This change looks topics up with \`TopicEmbed.with\_embed\_urls\`, which uses the \`lower(embed\_url)\` index (~0.1s for the same feed), only loads the columns it needs, and builds lookup keys with \`TopicEmbed.embed\_url\_key\` so they can't drift from the core query.
>
> Reported at https://meta.discourse.org/t/412322
>
> Stacked on https://github.com/discourse/discourse/pull/43643
---
### Author:  [@icaria36](https://meta.discourse.org/u/icaria36)
#### Post date: [15 september 2026 om 08:44 UTC](https://meta.discourse.org/t/rss-polling-may-take-20-minutes-and-more-to-process-a-feed/412322/6 "2026-09-15T08:44:30Z")
**O M G !!!**
Thank you so much! That was quick and precise.
I’m very happy of our little contribution reporting this problem. Even if our case is quite a corner case (I guess?), the solution will contribute at a smaller degree to the performance of basically any Discourse instance using this plugin.
I see the patches are merged. Does this mean that we can get them by updating Discourse now?
---
### Author:  [@Moin](https://meta.discourse.org/u/Moin)
#### Post date: [15 september 2026 om 09:00 UTC](https://meta.discourse.org/t/rss-polling-may-take-20-minutes-and-more-to-process-a-feed/412322/7 "2026-09-15T09:00:06Z")
Merged means that the changes are in `main`. Usually, forums don’t track the main branch; instead, they track `latest`. This means that after merging, you still have to wait for the automatic tests to run and pass.
When you are looking at [Commits · discourse/discourse · GitHub](https://github.com/discourse/discourse/commits/main), you can see that this has just happened with zogstrip’s commits (there is a green check mark, while the commit above still has the brown dot).
And you can now also see the commits when looking at the `latest` branch: [Commits · discourse/discourse · GitHub](https://github.com/discourse/discourse/commits/latest)
So if you are tracking `latest`, which forums do by default, you can update now to pull those commits.
---
### Author:  [@icaria36](https://meta.discourse.org/u/icaria36)
#### Post date: [15 september 2026 om 11:55 UTC](https://meta.discourse.org/t/rss-polling-may-take-20-minutes-and-more-to-process-a-feed/412322/8 "2026-09-15T11:55:20Z")
I have reenabled the RSS feeds and the first RSS round has mostly gone through. 86 new posts have appeared, many of them from days ago, which means that several feeds were not able to complete their processing before, and now they have. Very good!
Very long feeds still can keep a job busy for a long time, but I have only seen 3 going beyond 10 minutes. [This one](https://feeds.ivoox.com/feed_fg_f19404_filtro_1.xml) is still running after 1 hour… But it is really long, so maybe it is justified? Then again, a single feed taking one job for so long is kind of problematic in itself. Maybe it has to do with being the first full import in a while? I will check again in the next RSS round (we have it set to 180 minutes).
---
### Author:  [@icaria36](https://meta.discourse.org/u/icaria36)
#### Post date: [15 september 2026 om 12:02 UTC](https://meta.discourse.org/t/rss-polling-may-take-20-minutes-and-more-to-process-a-feed/412322/9 "2026-09-15T12:02:33Z")
Maybe that job running during one hour is stuck on something beyond the import? I have just noticed that all the posts of that feed seem to have been imported, with images and everything. At least from the user point of view, the import seems to be done. Maybe it’s an outlier. I will report again after a couple more RSS rounds.
---
### Author:  [@zogstrip](https://meta.discourse.org/u/zogstrip)
#### Post date: [15 september 2026 om 13:20 UTC](https://meta.discourse.org/t/rss-polling-may-take-20-minutes-and-more-to-process-a-feed/412322/10 "2026-09-15T13:20:15Z")
> [@icaria36](#):
>
> I have reenabled the RSS feeds and the first RSS round has mostly gone through. 86 new posts have appeared, many of them from days ago, which means that several feeds were not able to complete their processing before, and now they have. Very good!
nice 👍
> [@icaria36](#):
>
> Very long feeds still can keep a job busy for a long time, but I have only seen 3 going beyond 10 minutes. [This one](https://feeds.ivoox.com/feed_fg_f19404_filtro_1.xml) is still running after 1 hour… But it is really long, so maybe it is justified? Then again, a single feed taking one job for so long is kind of problematic in itself. Maybe it has to do with being the first full import in a while? I will check again in the next RSS round (we have it set to 180 minutes).
are those feeds “new” or have they all been already imported? i haven’t done much when it comes to improving how fast we do the initial import as this is largely limited by how “fast” we can create new topic.
---
### Author:  [@icaria36](https://meta.discourse.org/u/icaria36)
#### Post date: [16 september 2026 om 11:22 UTC](https://meta.discourse.org/t/rss-polling-may-take-20-minutes-and-more-to-process-a-feed/412322/11 "2026-09-16T11:22:20Z")
> [@zogstrip](#):
>
> are those feeds “new” or have they all been already imported?
They are all already imported.
Ok, we have changed the polling frequency to 10 minutes for the sake of testing (we will bring it back to 180 minutes, good enough for us). After zogstrip’s fix, most feeds are processed within a minute or less. There is only a couple of very long feeds that can get to 2 minutes and beyond, but never (that I have seen) beyond 5 minutes. [This RSS feed](https://feeds.ivoox.com/feed_fg_f19404_filtro_1.xml) is the only one that reliably gets to 4 minutes or more, but it is extremely long, so I’m not sure much can be done about this use case. Even the browser needs while to just render it. (And we might remove it for unrelated reasons.)
The fact that the entire polling process doesn’t take more than 5-6 minutes is astounding. A huge improvement. For me, this report can be resolved. Thank you very much again, @zogstrip.
---
### Author:  [@zogstrip](https://meta.discourse.org/u/zogstrip)
#### Post date: [16 september 2026 om 12:05 UTC](https://meta.discourse.org/t/rss-polling-may-take-20-minutes-and-more-to-process-a-feed/412322/12 "2026-09-16T12:05:39Z")
---
### Author:  [@system](https://meta.discourse.org/u/system)
#### Post date: [18 september 2026 om 12:09 UTC](https://meta.discourse.org/t/rss-polling-may-take-20-minutes-and-more-to-process-a-feed/412322/14 "2026-09-18T12:09:13Z")