In an effort to update our Forum I did a fresh VPS install + Restore on the weekend. This was going to solve multiple issues for us: Renew outdated ubuntu Update Discourse Upgrade to Postgres 15 While generally things went fine I saw issues coming up afterwards with Postgres processes going wild…

Right now it’s only one sidekiq task running with “Jobs::BackfillBadge” but still 7 postgres processes are seemingly blocking 100% cpu constantly. Really curious what’s going on there. [Screenshot 2025-02-17 @ 14.59.12@2x]

[image] Helmi: I did a fresh VPS install + Restore on the weekend. After such moves it is a good idea to run a vacuum for database stats.

That test serer is on 32GB, 16 core, config is set to 64MB work mem. EDIT: Shared buffers are at 8GB Currently doing a vaccuum which looks stuck [Screenshot 2025-02-17 @ 17.00.32@2x] Not sure if it’s doing something but it’s been there for 30+ minutes already. I did put the forum to read only …

You really don’t want to run a vacuum full. All you need to get performance back is a VACUUM VERBOSE ANALYZE. You can’t run a FULL in a running site.

I’m not expert at huge databases, but I’d make the buffers two or three times that. I’m sure you have indexes that are 8gb

[image] Jay Pfaffman: I’m not expert at huge databases, but I’d make the buffers two or three times that. :thinking: Postgres recommends never setting shared_buffers over 40% of the internal memory? That said, [image] Helmi: our database is quite huge - we’re at around 150gb after the r…

[image] Richard - Communiteq: Postgres recommends never setting shared_buffers over 40% of the internal memory? Aha! Sensible advice from an expert! So maybe I was right that 8GB/25% isn’t enough, and though 16GB is more than 40%, it might still be a good suggestion because . . . . [image…

Guys. as said this is a test server - there is no traffic on it. This server definitely isn’t good enough for production use but that’s not the issue here. The question is why we do see postgres processes sticking like that (with 100% CPU usage) and slowing down things drastically. We were running t…

Endlessly running Postgres processes & bad performance after Reinstall/restore

Support

pfaffman (Jay Pfaffman) February 17, 2025, 3:53pm 4

How much ram and cpu do you have?

How much memory do you give postgres?

Topic		Replies	Views
Slow Sidekiq + Postmaster using 95%+ CPU (32 cores) after Postgresql Version Upgrade Self-hosting server-resources	22	3177	May 29, 2020
Postgres using 100% of CPU Self-hosting server-resources	16	20096	August 25, 2018
Post 3.5.1 update - CPU maxed out 100% Support	4	148	February 4, 2025
Primary Postgres database process (postmaster) eating all CPU Self-hosting server-resources	13	4180	May 28, 2020
Server load issues (after rebuild hanged) Self-hosting	4	231	May 19, 2024

Endlessly running Postgres processes & bad performance after Reinstall/restore

Related topics