We just had peak traffic of approx 1,500 concurrent (mostly anonymous) users visiting a single page. And the forum went into the mode, where the warning is displayed to all members concerning high load. CPU-Optimized Digital Ocean Droplet Dedicated CPU: 4 vCPUs RAM: 8 GB Unicorn workers: 10 Given only approx. 50% of RAM and CPU are utilized would it help to increase unicorn workers for such peak traffic cases from anonymous visitors or not? [image]

Yes, increasing unicorns is the first step here.

I have increased the workers to 24. No difference (goes still into “Due to extreme load, this is temporarily being shown to everyone as a logged-out user would see it.”), with a similar concurrent visitor peak (99% anonymous) just now: [image]

I know @sam has spent a lot of time on this recently and might have commentary?

@sam Any ideas on how to further optimize for peak traffic from anonymous traffic (e.g. if a singe topic goes viral on social media). In both cases outlined above, memory and CPU still have plenty of room (according to Digital Ocean), and we have not even hit a load of 4, still, the forum goes into “extreme load” mode, despite tripled the number of workers.

[image] Just went into “extreme load mode” again, with only 600 concurrent visitors total (99% anonymous) and a load of not even 1.

You need to collect some data so we know what is the bottleneck. Prometheus exporter plugin for Discourse

I believe the DO data monitor is not sensitive enough and somewhat misleading. I experimented with extreme load with Hetzner and Digital ocean. With Hetzner when the extreme load message came up there was a short sharp peak where it would go to 120%. It lasted maybe a second, before dropping down to 40-50% mark. Recreated the same thing with Digital ocean , and from memory it appeared CPU usage never got above 50%. (but you could not change the x axis to the seconds level) My guess is DO CPU level is maybe the average of 5 or 15 seconds. So you dont see the short sharp peaks

We are going to need prometheus exporter reports to look any deeper. If you have the ram and the cpu … you can always add more unicorn workers, that will scale up for these peaks. You just don’t want to swap memory, cause performance will go way down.

[imagem] Terrapop: Any ideas on how to further optimize for peak traffic from anonymous traffic (e.g. if a singe topic goes viral on social media). Seems like in such a case that single topic page should be able to be cached and served statically for a short period without having to hit the back end at all. I’ve no idea if Discourse can do that (i.e. set cache control headers when under load and serving content to anon users) and if the DO setup has a capable caching proxy in the chain, but it’s a development idea that might be worth a thought if I’m not totally wrong and it isn’t already done. Maybe @sam already thought or did this, or knows why it is a bad idea!

That already happens dynamically under measured load on a per-topic basis, that’s exactly what [imagem] Terrapop: the forum went into the mode, where the warning is displayed to all members concerning high load. .. is referring to. It’s READ ONLY though, so people can’t actually have conversations in that mode.

Alta carga devido a sessões anônimas de pico, aumentar workers do unicorn?

Suporte ao Produto

Falco (Falco) 21 Fevereiro , 2021 01:23 7

Você precisa coletar alguns dados para que saibamos qual é o gargalo.

Plugin exportador Prometheus para Discourse

Tópico		Respostas	Vistas
High CPU usage (Ruby) Product Support server-resources	20	1107	3 Fevereiro , 2025
Best configurations for speeding up standalone discourse Self-hosting server-resources	25	4710	14 Fevereiro , 2024
Optimizing the number of Unicorns and buffer size Self-hosting server-resources	22	7166	9 Junho , 2018
Getting extreme load warning while server resources are not being used Self-hosting	5	1012	2 Setembro , 2021
Recommendation for number of workers: cores × 2? Self-hosting	16	739	29 Abril , 2025

Alta carga devido a sessões anônimas de pico, aumentar workers do unicorn?

Related topics