Rebuild stuck on "building..."?

Everything seemed to be going fine after running sudo ./launcher rebuild app, but towards the end of the process it seems to have gotten stuck on “building…”. It’s been here for 30 minutes now. I’ve never seen a rebuild take this long before or get stuck at this point before. Checking top, it doesn’t look like anything is taxing the system in any meaningful way.

...lots of log output - all normal stuff I'm used to seeing during a rebuild
I, [2022-02-07T18:39:08.172725 #1228]  INFO -- : Writing /var/www/discourse/public/assets/logo-single-d7a0dacc998273856c42737dba8693fbdb9e5fd929d36afeb3f13844f147e865.png
I, [2022-02-07T18:39:08.175841 #1228]  INFO -- : Writing /var/www/discourse/public/assets/logo-ba2f2da6eac779d8b34d4aa977be739e4de07f7d34e970f4b8ac32682706c122.png
I, [2022-02-07T18:39:08.178997 #1228]  INFO -- : Writing /var/www/discourse/public/assets/push-notifications/check-f64a79b1bde9a9e1f6fdc1ab382163596a06e3ae71443bb8c8231aa595bcbc80.png
I, [2022-02-07T18:39:08.182201 #1228]  INFO -- : Writing /var/www/discourse/public/assets/push-notifications/discourse-bdbc548a4e328f39b017bb143b679c5dfe7b060574760cd71d77971c2a9eff1f.png
I, [2022-02-07T18:39:08.186061 #1228]  INFO -- : Writing /var/www/discourse/public/assets/push-notifications/group_mentioned-012ba348812e600c5532b8ccc08e8767b16fd126f3c7bcedcbdedaba640721d6.png
I, [2022-02-07T18:39:08.190513 #1228]  INFO -- : Writing /var/www/discourse/public/assets/push-notifications/linked-02191f88212f5cba22760235346da4e238eb9a4c9056cac92965a940eeaa02d0.png
I, [2022-02-07T18:39:08.194565 #1228]  INFO -- : Writing /var/www/discourse/public/assets/push-notifications/mentioned-012ba348812e600c5532b8ccc08e8767b16fd126f3c7bcedcbdedaba640721d6.png
I, [2022-02-07T18:39:08.198835 #1228]  INFO -- : Writing /var/www/discourse/public/assets/push-notifications/posted-918b5c4333d62ea140dfc63a49d1ee60e71f00418b8f2f7fa91bb65a2c995830.png
I, [2022-02-07T18:39:08.203082 #1228]  INFO -- : Writing /var/www/discourse/public/assets/push-notifications/private_message-77576c8c5017882f813792be99ee57b2ddaa417c2baf74255a9899867ad66b97.png
I, [2022-02-07T18:39:08.207149 #1228]  INFO -- : Writing /var/www/discourse/public/assets/push-notifications/quoted-a1bf4d7b4f4ad6b34b43d60143a7e07ddc030855eae2cf9308011ba91a3ce168.png
I, [2022-02-07T18:39:08.210809 #1228]  INFO -- : Writing /var/www/discourse/public/assets/push-notifications/replied-918b5c4333d62ea140dfc63a49d1ee60e71f00418b8f2f7fa91bb65a2c995830.png
- Building
- Building
- building... 

Any ideas of what might be going on here and how it could be fixed? This is a pretty major issue at the moment since it’s preventing running the site at all. Thanks!

4 Likes

Well, good news. It did finally finish building and launch properly (about 45 minutes later). Not sure why it took so much longer than normal and it didn’t appear to be doing much of anything for so long. Some additional output might be nice when it gets to that stage?

3 Likes

Glad to hear it finished eventually! Could you share the specs of your server? How much RAM / swap do you have?

2 Likes

A total of 4GB RAM, though 2GB was already in use by other processes on the server (hosting a couple wordpress sites via apache and a mysql database).

It’s a 2 Core Intel Digital Ocean droplet. Zero swap space by default setup.

1 Like

Something is very, very wrong with that server. I suspect a massively slow disk (maybe it’s Ye Olde Spinny Rust Hard Drive and not a modern M.2 SSD?) since that will tank performance. Run some basic disk benchmarks at the command line.

4 Likes