Hi all, hoping for some help! Has anyone experienced this before? ./launcher rebuild app is running, get’s to this point and just hangs here. [image] Now it is doing something, but it’s doing it extremely slowly. I’ve been running the forum via a self installed digital ocean droplet for 3 years now, but this is new and is causing a lot of downtime. Is there a way to smooth this out? Is it to do with images on the forum or something?

A VM is the common term for what DigitalOcean calls a droplet. Sounds like you might want to take a look at my profile and considered managed hosting though :wink:

[תמונה] Falco: Something like ps aux | grep postgres should show the start of it. ystemd+ 7660 0.0 0.3 352060 28284 ? S 22:31 0:00 /usr/lib/postgresql/13/bin/postmaster -D /etc/postgresql/13/main systemd+ 7667 0.0 0.1 352588 9628 ? Ss 22:31 0:00 postgres: 13/main: checkpointer systemd+ 7668 0.3 0.9 352060 78796 ? Ss 22:31 0:03 postgres: 13/main: background writer systemd+ 7669 0.0 0.1 352060 13696 ? Ss 22:31 0:00 postgres: 13/main: walwriter systemd+ 7670 0.0 0.1 352728 11892 ? Ss 22:31 0:00 postgres: 13/main: autovacuum launcher systemd+ 7671 0.0 0.0 67996 5320 ? Ss 22:31 0:00 postgres: 13/main: stats collector systemd+ 7672 0.0 0.0 352612 6640 ? Ss 22:31 0:00 postgres: 13/main: logical replication launcher systemd+ 10900 82.0 3.8 487164 317728 ? Rs 22:33 10:42 postgres: 13/main: discourse discourse [local] DELETE systemd+ 10901 0.0 0.1 353432 13804 ? Ss 22:33 0:00 postgres: 13/main: discourse discourse [local] idle htop shows that the discourse [local] delete is what’s eating 100% cpu. The droplet has 8GB of RAM, and right now 12 minutes. There are less than 600K posts and <4K users, so the database isn’t huge. Oh. Wait. the postgres_data directory is 28GB. I ran a VACUUM VERBOSE ANALYZE;. I did this: discourse=# SELECT checkpoints_timed, checkpoints_req FROM pg_stat_bgwriter; checkpoints_timed | checkpoints_req -------------------+----------------- 6 | 20 I’m now trying to reindex concurrently. Perhaps the vacuum and reindex will help.

[תמונה] Jay Pfaffman: postgres_data directory is 28GB. Thanks Jay. Let me know if there’s anything you need from me.

[תמונה] Jay Pfaffman: htop shows that the discourse [local] delete is what’s eating 100% cpu. The droplet has 8GB of RAM, and right now <1GB is in use (not counting buffers). Please share the whole SQL of the long running query.

Where do I find that? The migration isn’t printing any logs. THe last line in the rebuild is I, [2023-12-04T22:33:33.759401 #1] INFO -- : > cd /var/www/discourse && su discourse -c 'bundle exec rake db:migrate' I"m working on a full log for the one that I just restarted.

Enter the container, switch to the postgres user, enter psql and run SELECT pid, age(clock_timestamp(), query_start), usename, query FROM pg_stat_activity WHERE query != ' ' AND query NOT ILIKE '%pg_stat_activity%' ORDER BY query_start desc;

Lads - really appreciate the assistance here and @pfaffman - please don’t work late on my account. Forum goers will simply have to wait if you need to log off for the evening.

[תמונה] Jay Pfaffman: discourse=# select count(*) from calendar_events; count ---------- 69724384 (1 row) Whoa what is that?

That’s the calendar plugin FIX: remove duplicated holidays because of timezone change (#489) committed 03:48AM - 24 Nov 23 UTC (UTC) [תמונה] KrisKotlarek +56 -11 When a user updates timezone, it creates duplicated holidays. Beside the fix,… migration was added to remove duplicated records. Timezone change can only update date for 24 hours, so we are searching for records with start date around that range. Is that running for 7 hours or 7 minutes?

'bundle exec rake db:migrate' מתארך עקב הגירת לוח שנה

תמיכה התקנה

pfaffman (Jay Pfaffman) 5 בדצמבר,‏ 2023,‏ 12:31am 30

I’ll ping you in the morning about how to clean things up.

נושא		תגובות	צפיות
Database migration chokes on huge value of a "calendar-details" item in table "post_custom_fields" Bug	12	2348	7 בדצמבר,‏ 2020
Discourse installation has been getting slower and slower and slower Self-hosting server-resources	36	2349	15 באפריל,‏ 2023
Help! Upgrade led to complete fail Self-hosting	7	1590	9 במרץ,‏ 2021
Restore fails due to disk space on migration because of 70M calendar events Product Support events	10	427	14 בפברואר,‏ 2026
PostgreSQL Stuck During Rebuilding Self-hosting	51	3116	4 בספטמבר,‏ 2024

'bundle exec rake db:migrate' מתארך עקב הגירת לוח שנה

נושאים קשורים