Slow Discourse Rebuild on a VM with slow disks

rgrunbla · February 12, 2021, 11:01am

Hi everyone,

We’re using discourse in a virtual machine on a server we own (using kvm, proxmox), and we’re observing very slow rebuild when updating our discourse server.

By slow, I mean it takes up to 30 minutes to execute a ./launcher rebuild app.

The host CPU are 32 x Intel® Xeon® Silver 4110 CPU @ 2.10GHz (2 Sockets), and the virtual machines have two kvm64 cores on a single CPU.

My questions are the following:

Is this rebuild time expected ?
Is the rebuild somehow parallelized, and will adding more cores to our virtual machine instance speed up the process ?

Downtime is not really this big of a issue, so I’m not sure I really want to migrate to a more complex setup involving multiple containers and specific rebuild that would allow for less downtime, but any hint to speed up this process would be appreciated.

Thanks

Overgrow · February 12, 2021, 11:23am

You have 2cores @2ghz… probably with only 8gb ram and HDD… that would justify slow rebuild.

Definitely more RAM and faster SSDs would speed it up. Imho majority of the jobs during rebuild are singlethreaded.

But the only proper solution is a two container setup.

Timelord · February 12, 2021, 12:24pm

That is very slow. We can rebuild our forum in less than five minutes on a single Ryzen 3900 thread. and 1GB RAM. Granted, the forum is very small (6k posts).

pfaffman · February 12, 2021, 1:54pm

You have SSD?

Are you on a slow internet connection?

Single thread speed is important.

I’ve not seen a rebuild take that long. Do you have a big database? Lots of themes? Lots of plugins?

rgrunbla · February 12, 2021, 2:10pm

Small database, maybe one theme, and a few plugins:

- https://github.com/discourse/docker_manager.git
- https://github.com/discourse/discourse-openid-connect.git
- https://github.com/discourse/discourse-math.git
- https://github.com/discourse/discourse-spoiler-alert
- https://github.com/discourse/discourse-solved.git
- https://github.com/discourse/discourse-chat-integration.git

Let me rebuild it manually and check how long it takes.

Here is some log:

aliens@forum:/var/discourse$ time sudo ./launcher rebuild app
[…]
real	22m27.712s
user	0m2.069s
sys	0m1.470s

I, [2021-02-12T14:12:45.955900 #1]  INFO -- : Loading --stdin
I, [2021-02-12T14:12:45.962212 #1]  INFO -- : > locale-gen $LANG && update-locale
I, [2021-02-12T14:12:46.633275 #1]  INFO -- : Generating locales (this might take a while)...
I, [2021-02-12T14:12:46.633768 #1]  INFO -- : > mkdir -p /shared/postgres_run
I, [2021-02-12T14:12:46.637076 #1]  INFO -- :
I, [2021-02-12T14:12:46.637442 #1]  INFO -- : > chown postgres:postgres /shared/postgres_run
I, [2021-02-12T14:12:46.640032 #1]  INFO -- :
I, [2021-02-12T14:12:46.640326 #1]  INFO -- : > chmod 775 /shared/postgres_run
I, [2021-02-12T14:12:46.642547 #1]  INFO -- :
I, [2021-02-12T14:12:46.642869 #1]  INFO -- : > rm -fr /var/run/postgresql
I, [2021-02-12T14:12:46.645856 #1]  INFO -- :
I, [2021-02-12T14:12:46.646137 #1]  INFO -- : > ln -s /shared/postgres_run /var/run/postgresql
I, [2021-02-12T14:12:46.666510 #1]  INFO -- :
I, [2021-02-12T14:12:46.666914 #1]  INFO -- : > socat /dev/null UNIX-CONNECT:/shared/postgres_run/.s.PGSQL.5432 || exit 0 && echo postgres already running stop container ; exit 1
I, [2021-02-12T14:12:47.168264 #1]  INFO -- :
I, [2021-02-12T14:12:47.168523 #1]  INFO -- : > rm -fr /shared/postgres_run/.s*
I, [2021-02-12T14:12:47.172123 #1]  INFO -- :
I, [2021-02-12T14:12:47.172331 #1]  INFO -- : > rm -fr /shared/postgres_run/*.pid
I, [2021-02-12T14:12:47.175386 #1]  INFO -- :
I, [2021-02-12T14:12:47.175693 #1]  INFO -- : > mkdir -p /shared/postgres_run/13-main.pg_stat_tmp
I, [2021-02-12T14:12:47.178473 #1]  INFO -- :
I, [2021-02-12T14:12:47.178875 #1]  INFO -- : > chown postgres:postgres /shared/postgres_run/13-main.pg_stat_tmp
I, [2021-02-12T14:12:47.181231 #1]  INFO -- :
I, [2021-02-12T14:12:47.187254 #1]  INFO -- : File > /etc/service/postgres/run  chmod: +x  chown:
I, [2021-02-12T14:12:47.192927 #1]  INFO -- : File > /etc/service/postgres/log/run  chmod: +x  chown:
I, [2021-02-12T14:12:47.198897 #1]  INFO -- : File > /etc/runit/3.d/99-postgres  chmod: +x  chown:
I, [2021-02-12T14:12:47.204663 #1]  INFO -- : File > /root/upgrade_postgres  chmod: +x  chown:
I, [2021-02-12T14:12:47.205062 #1]  INFO -- : > chown -R root /var/lib/postgresql/13/main
I, [2021-02-12T14:15:21.256384 #1]  INFO -- :
I, [2021-02-12T14:15:21.257009 #1]  INFO -- : > [ ! -e /shared/postgres_data ] && install -d -m 0755 -o postgres -g postgres /shared/postgres_data && sudo -E -u postgres /usr/lib/postgresql/13/bin/initdb -D /shared/postgres_data || exit 0
I, [2021-02-12T14:15:21.259981 #1]  INFO -- :
I, [2021-02-12T14:15:21.260154 #1]  INFO -- : > chown -R postgres:postgres /shared/postgres_data
I, [2021-02-12T14:15:21.948040 #1]  INFO -- :
I, [2021-02-12T14:15:21.948552 #1]  INFO -- : > chown -R postgres:postgres /var/run/postgresql
I, [2021-02-12T14:15:21.951704 #1]  INFO -- :
I, [2021-02-12T14:15:21.952027 #1]  INFO -- : > /root/upgrade_postgres
I, [2021-02-12T14:15:21.975184 #1]  INFO -- :
I, [2021-02-12T14:15:21.975342 #1]  INFO -- : > rm /root/upgrade_postgres
I, [2021-02-12T14:15:21.977953 #1]  INFO -- :
I, [2021-02-12T14:15:22.013157 #1]  INFO -- : Replacing data_directory = '/var/lib/postgresql/13/main' with data_directory = '/shared/postgres_data' in /etc/postgresql/13/main/postgresql.conf
I, [2021-02-12T14:15:22.014186 #1]  INFO -- : Replacing (?-mix:#?listen_addresses *=.*) with listen_addresses = '*' in /etc/postgresql/13/main/postgresql.conf
I, [2021-02-12T14:15:24.436709 #1]  INFO -- : Replacing (?-mix:#?synchronous_commit *=.*) with synchronous_commit = $db_synchronous_commit in /etc/postgresql/13/main/postgresql.conf
I, [2021-02-12T14:15:24.628433 #1]  INFO -- : Replacing (?-mix:#?shared_buffers *=.*) with shared_buffers = $db_shared_buffers in /etc/postgresql/13/main/postgresql.conf
I, [2021-02-12T14:15:25.159240 #1]  INFO -- : Replacing (?-mix:#?work_mem *=.*) with work_mem = $db_work_mem in /etc/postgresql/13/main/postgresql.conf
I, [2021-02-12T14:15:25.184384 #1]  INFO -- : Replacing (?-mix:#?default_text_search_config *=.*) with default_text_search_config = '$db_default_text_search_config' in /etc/postgresql/13/main/postgresql.conf
I, [2021-02-12T14:15:25.259466 #1]  INFO -- : > install -d -m 0755 -o postgres -g postgres /shared/postgres_backup
I, [2021-02-12T14:15:25.309111 #1]  INFO -- :
I, [2021-02-12T14:15:25.309652 #1]  INFO -- : Replacing (?-mix:#?checkpoint_segments *=.*) with checkpoint_segments = $db_checkpoint_segments in /etc/postgresql/13/main/postgresql.conf
I, [2021-02-12T14:15:25.377742 #1]  INFO -- : Replacing (?-mix:#?logging_collector *=.*) with logging_collector = $db_logging_collector in /etc/postgresql/13/main/postgresql.conf
I, [2021-02-12T14:15:25.441337 #1]  INFO -- : Replacing (?-mix:#?log_min_duration_statement *=.*) with log_min_duration_statement = $db_log_min_duration_statement in /etc/postgresql/13/main/postgresql.conf
I, [2021-02-12T14:15:25.552764 #1]  INFO -- : Replacing (?-mix:^#local +replication +postgres +peer$) with local replication postgres  peer in /etc/postgresql/13/main/pg_hba.conf
I, [2021-02-12T14:15:25.553289 #1]  INFO -- : Replacing (?-mix:^host.*all.*all.*127.*$) with host all all 0.0.0.0/0 md5 in /etc/postgresql/13/main/pg_hba.conf
I, [2021-02-12T14:15:25.590760 #1]  INFO -- : > HOME=/var/lib/postgresql USER=postgres exec chpst -u postgres:postgres:ssl-cert -U postgres:postgres:ssl-cert /usr/lib/postgresql/13/bin/postmaster -D /etc/postgresql/13/main
I, [2021-02-12T14:15:25.594118 #1]  INFO -- : > sleep 5
I, [2021-02-12T14:15:30.597053 #1]  INFO -- :
I, [2021-02-12T14:15:30.597375 #1]  INFO -- : > su postgres -c 'createdb discourse' || true
I, [2021-02-12T14:15:31.013293 #1]  INFO -- :
I, [2021-02-12T14:15:31.013704 #1]  INFO -- : > su postgres -c 'psql discourse -c "create user discourse;"' || true
I, [2021-02-12T14:15:31.160001 #1]  INFO -- :
I, [2021-02-12T14:15:31.160404 #1]  INFO -- : > su postgres -c 'psql discourse -c "grant all privileges on database discourse to discourse;"' || true
I, [2021-02-12T14:15:31.220487 #1]  INFO -- : GRANT
I, [2021-02-12T14:15:31.220749 #1]  INFO -- : > su postgres -c 'psql discourse -c "alter schema public owner to discourse;"'
I, [2021-02-12T14:15:31.304366 #1]  INFO -- : ALTER SCHEMA
I, [2021-02-12T14:15:31.304675 #1]  INFO -- : > su postgres -c 'psql template1 -c "create extension if not exists hstore;"'
I, [2021-02-12T14:15:31.402388 #1]  INFO -- : CREATE EXTENSION
I, [2021-02-12T14:15:31.402649 #1]  INFO -- : > su postgres -c 'psql template1 -c "create extension if not exists pg_trgm;"'
I, [2021-02-12T14:15:31.463813 #1]  INFO -- : CREATE EXTENSION
I, [2021-02-12T14:15:31.464222 #1]  INFO -- : > su postgres -c 'psql discourse -c "create extension if not exists hstore;"'
I, [2021-02-12T14:15:31.560706 #1]  INFO -- : CREATE EXTENSION
I, [2021-02-12T14:15:31.560939 #1]  INFO -- : > su postgres -c 'psql discourse -c "create extension if not exists pg_trgm;"'
I, [2021-02-12T14:15:31.624479 #1]  INFO -- : CREATE EXTENSION
I, [2021-02-12T14:15:31.624979 #1]  INFO -- : > sudo -u postgres psql discourse
I, [2021-02-12T14:15:32.086935 #1]  INFO -- : update pg_database set encoding = pg_char_to_encoding('UTF8') where datname = 'discourse' AND encoding = pg_char_to_encoding('SQL_ASCII');
I, [2021-02-12T14:15:32.265765 #1]  INFO -- : File > /var/lib/postgresql/take-database-backup  chmod: +x  chown: postgres:postgres
I, [2021-02-12T14:15:32.268912 #1]  INFO -- : File > /var/spool/cron/crontabs/postgres  chmod:   chown:
I, [2021-02-12T14:15:32.269014 #1]  INFO -- : > echo postgres installed!
I, [2021-02-12T14:15:32.271341 #1]  INFO -- : postgres installed!
I, [2021-02-12T14:15:32.277041 #1]  INFO -- : File > /etc/service/redis/run  chmod: +x  chown:
I, [2021-02-12T14:15:32.282518 #1]  INFO -- : File > /etc/service/redis/log/run  chmod: +x  chown:
I, [2021-02-12T14:15:32.287789 #1]  INFO -- : File > /etc/runit/3.d/10-redis  chmod: +x  chown:
I, [2021-02-12T14:15:32.311455 #1]  INFO -- : Replacing daemonize yes with  in /etc/redis/redis.conf
I, [2021-02-12T14:15:32.312156 #1]  INFO -- : Replacing (?-mix:^pidfile.*$) with  in /etc/redis/redis.conf
I, [2021-02-12T14:15:33.185632 #1]  INFO -- : > install -d -m 0755 -o redis -g redis /shared/redis_data
I, [2021-02-12T14:15:33.189667 #1]  INFO -- :
I, [2021-02-12T14:15:33.190303 #1]  INFO -- : Replacing (?-mix:^logfile.*$) with logfile "" in /etc/redis/redis.conf
I, [2021-02-12T14:15:33.248320 #1]  INFO -- : Replacing (?-mix:^bind .*$) with  in /etc/redis/redis.conf
I, [2021-02-12T14:15:33.280622 #1]  INFO -- : Replacing (?-mix:^dir .*$) with dir /shared/redis_data in /etc/redis/redis.conf
I, [2021-02-12T14:15:33.316107 #1]  INFO -- : Replacing (?-mix:^protected-mode yes) with protected-mode no in /etc/redis/redis.conf
I, [2021-02-12T14:15:33.371939 #1]  INFO -- : Replacing # io-threads 4 with io-threads $redis_io_threads in /etc/redis/redis.conf
I, [2021-02-12T14:15:33.380946 #1]  INFO -- : > echo redis installed
I, [2021-02-12T14:15:33.383880 #1]  INFO -- : redis installed
I, [2021-02-12T14:15:33.384290 #1]  INFO -- : > cat /etc/redis/redis.conf | grep logfile
I, [2021-02-12T14:15:33.388772 #1]  INFO -- : logfile ""
I, [2021-02-12T14:15:33.389071 #1]  INFO -- : > exec chpst -u redis -U redis /usr/bin/redis-server /etc/redis/redis.conf
I, [2021-02-12T14:15:33.390851 #1]  INFO -- : > sleep 10
I, [2021-02-12T14:15:43.393519 #1]  INFO -- :
I, [2021-02-12T14:15:43.394261 #1]  INFO -- : > thpoff echo "thpoff is installed!"
I, [2021-02-12T14:15:43.398396 #1]  INFO -- : thpoff is installed!
I, [2021-02-12T14:15:43.398644 #1]  INFO -- : > /usr/local/bin/ruby -e 'if ENV["DISCOURSE_SMTP_ADDRESS"] == "smtp.example.com"; puts "Aborting! Mail is not configured!"; exit 1; end'
I, [2021-02-12T14:15:43.482669 #1]  INFO -- :
I, [2021-02-12T14:15:43.483047 #1]  INFO -- : > /usr/local/bin/ruby -e 'if ENV["DISCOURSE_HOSTNAME"] == "discourse.example.com"; puts "Aborting! Domain is not configured!"; exit 1; end'
I, [2021-02-12T14:15:43.558655 #1]  INFO -- :
I, [2021-02-12T14:15:43.558943 #1]  INFO -- : > /usr/local/bin/ruby -e 'if (ENV["DISCOURSE_CDN_URL"] || "")[0..1] == "//"; puts "Aborting! CDN must have a protocol specified. Once fixed you should rebake your posts now to correct all posts."; exit 1; end'
I, [2021-02-12T14:15:43.641372 #1]  INFO -- :
I, [2021-02-12T14:15:43.641677 #1]  INFO -- : > chown -R discourse /home/discourse
I, [2021-02-12T14:16:45.838187 #1]  INFO -- :
I, [2021-02-12T14:16:45.840385 #1]  INFO -- : > rm -f /etc/cron.d/anacron
I, [2021-02-12T14:16:45.844572 #1]  INFO -- :
I, [2021-02-12T14:16:45.850050 #1]  INFO -- : File > /etc/cron.d/anacron  chmod:   chown:
I, [2021-02-12T14:16:45.855854 #1]  INFO -- : File > /etc/runit/1.d/copy-env  chmod: +x  chown:
I, [2021-02-12T14:16:45.861277 #1]  INFO -- : File > /etc/service/unicorn/run  chmod: +x  chown:
I, [2021-02-12T14:16:45.866688 #1]  INFO -- : File > /etc/service/nginx/run  chmod: +x  chown:
I, [2021-02-12T14:16:45.872249 #1]  INFO -- : File > /etc/runit/3.d/01-nginx  chmod: +x  chown:
I, [2021-02-12T14:16:45.877861 #1]  INFO -- : File > /etc/runit/3.d/02-unicorn  chmod: +x  chown:
I, [2021-02-12T14:16:45.878086 #1]  INFO -- : Replacing # postgres with sv start postgres || exit 1 in /etc/service/unicorn/run
I, [2021-02-12T14:16:45.878406 #1]  INFO -- : > exec chpst -u redis -U redis /usr/bin/redis-server /etc/redis/redis.conf
I, [2021-02-12T14:16:45.880542 #1]  INFO -- : > cd /var/www/discourse && git reset --hard
I, [2021-02-12T14:17:02.926735 #1]  INFO -- : HEAD is now at c4552e9c FIX: Autoplay videos must always be muted (#11533)
I, [2021-02-12T14:17:02.927239 #1]  INFO -- : > cd /var/www/discourse && git clean -f
I, [2021-02-12T14:17:03.084509 #1]  INFO -- :
I, [2021-02-12T14:17:03.084936 #1]  INFO -- : > cd /var/www/discourse && git remote set-branches --add origin master
I, [2021-02-12T14:17:03.089849 #1]  INFO -- :
I, [2021-02-12T14:17:03.090120 #1]  INFO -- : > cd /var/www/discourse && git remote set-branches origin tests-passed
I, [2021-02-12T14:17:03.124282 #1]  INFO -- :
I, [2021-02-12T14:17:03.124588 #1]  INFO -- : > cd /var/www/discourse && git fetch --depth 1 origin tests-passed
I, [2021-02-12T14:17:08.243029 #1]  INFO -- :
I, [2021-02-12T14:17:08.243186 #1]  INFO -- : > cd /var/www/discourse && git checkout tests-passed
I, [2021-02-12T14:17:09.184686 #1]  INFO -- : Branch 'tests-passed' set up to track remote branch 'tests-passed' from 'origin'.
I, [2021-02-12T14:17:09.185043 #1]  INFO -- : > cd /var/www/discourse && mkdir -p tmp
I, [2021-02-12T14:17:09.189503 #1]  INFO -- :
I, [2021-02-12T14:17:09.189934 #1]  INFO -- : > cd /var/www/discourse && chown discourse:www-data tmp
I, [2021-02-12T14:17:09.233988 #1]  INFO -- :
I, [2021-02-12T14:17:09.234524 #1]  INFO -- : > cd /var/www/discourse && mkdir -p tmp/pids
I, [2021-02-12T14:17:09.239129 #1]  INFO -- :
I, [2021-02-12T14:17:09.239356 #1]  INFO -- : > cd /var/www/discourse && mkdir -p tmp/sockets
I, [2021-02-12T14:17:09.243412 #1]  INFO -- :
I, [2021-02-12T14:17:09.243668 #1]  INFO -- : > cd /var/www/discourse && touch tmp/.gitkeep
I, [2021-02-12T14:17:09.247268 #1]  INFO -- :
I, [2021-02-12T14:17:09.247491 #1]  INFO -- : > cd /var/www/discourse && mkdir -p                    /shared/log/rails
I, [2021-02-12T14:17:09.251701 #1]  INFO -- :
I, [2021-02-12T14:17:09.251901 #1]  INFO -- : > cd /var/www/discourse && bash -c "touch -a           /shared/log/rails/{production,production_errors,unicorn.stdout,unicorn.stderr,sidekiq}.log"
I, [2021-02-12T14:17:09.257343 #1]  INFO -- :
I, [2021-02-12T14:17:09.257528 #1]  INFO -- : > cd /var/www/discourse && bash -c "ln    -s           /shared/log/rails/{production,production_errors,unicorn.stdout,unicorn.stderr,sidekiq}.log /var/www/discourse/log"
I, [2021-02-12T14:17:09.262945 #1]  INFO -- :
I, [2021-02-12T14:17:09.263138 #1]  INFO -- : > cd /var/www/discourse && bash -c "mkdir -p           /shared/{uploads,backups}"
I, [2021-02-12T14:17:09.268702 #1]  INFO -- :
I, [2021-02-12T14:17:09.269124 #1]  INFO -- : > cd /var/www/discourse && bash -c "ln    -s           /shared/{uploads,backups} /var/www/discourse/public"
I, [2021-02-12T14:17:09.274278 #1]  INFO -- :
I, [2021-02-12T14:17:09.274482 #1]  INFO -- : > cd /var/www/discourse && bash -c "mkdir -p           /shared/tmp/{backups,restores}"
I, [2021-02-12T14:17:09.279930 #1]  INFO -- :
I, [2021-02-12T14:17:09.280139 #1]  INFO -- : > cd /var/www/discourse && bash -c "ln    -s           /shared/tmp/{backups,restores} /var/www/discourse/tmp"
I, [2021-02-12T14:17:09.285209 #1]  INFO -- :
I, [2021-02-12T14:17:09.285457 #1]  INFO -- : > cd /var/www/discourse && chown -R discourse:www-data /shared/log/rails /shared/uploads /shared/backups /shared/tmp
I, [2021-02-12T14:17:09.396237 #1]  INFO -- :
I, [2021-02-12T14:17:09.396669 #1]  INFO -- : > cd /var/www/discourse && find public/plugins/ -maxdepth 1 -xtype l -delete
I, [2021-02-12T14:17:09.435442 #1]  INFO -- :
I, [2021-02-12T14:17:09.436219 #1]  INFO -- : Replacing # redis with sv start redis || exit 1 in /etc/service/unicorn/run
I, [2021-02-12T14:17:09.436996 #1]  INFO -- : > cd /var/www/discourse/app && sed -i "s/input value=accountUsername/input value=accountUsername disabled=true/" assets/javascripts/discourse/app/templates/modal/create-account.hbs
I, [2021-02-12T14:17:09.478457 #1]  INFO -- :
I, [2021-02-12T14:17:09.479245 #1]  INFO -- : > cd /var/www/discourse/plugins && git clone https://github.com/discourse/docker_manager.git
I, [2021-02-12T14:17:19.949506 #1]  INFO -- :
I, [2021-02-12T14:17:19.949666 #1]  INFO -- : > cd /var/www/discourse/plugins && git clone https://github.com/discourse/discourse-openid-connect.git
I, [2021-02-12T14:17:22.456981 #1]  INFO -- :
I, [2021-02-12T14:17:22.457375 #1]  INFO -- : > cd /var/www/discourse/plugins && git clone https://github.com/discourse/discourse-math.git
I, [2021-02-12T14:17:28.640267 #1]  INFO -- :
I, [2021-02-12T14:17:28.640409 #1]  INFO -- : > cd /var/www/discourse/plugins && git clone https://github.com/discourse/discourse-spoiler-alert
I, [2021-02-12T14:17:34.135485 #1]  INFO -- :
I, [2021-02-12T14:17:34.135603 #1]  INFO -- : > cd /var/www/discourse/plugins && git clone https://github.com/discourse/discourse-solved.git
I, [2021-02-12T14:17:42.135436 #1]  INFO -- :
I, [2021-02-12T14:17:42.135862 #1]  INFO -- : > cd /var/www/discourse/plugins && git clone https://github.com/discourse/discourse-chat-integration.git
I, [2021-02-12T14:17:46.531573 #1]  INFO -- :
I, [2021-02-12T14:17:46.532107 #1]  INFO -- : > cp /var/www/discourse/config/nginx.sample.conf /etc/nginx/conf.d/discourse.conf
I, [2021-02-12T14:17:46.574768 #1]  INFO -- :
I, [2021-02-12T14:17:46.575449 #1]  INFO -- : > rm /etc/nginx/sites-enabled/default
I, [2021-02-12T14:17:46.578367 #1]  INFO -- :
I, [2021-02-12T14:17:46.578696 #1]  INFO -- : > mkdir -p /var/nginx/cache
I, [2021-02-12T14:17:46.581540 #1]  INFO -- :
I, [2021-02-12T14:17:46.586431 #1]  INFO -- : Replacing pid /run/nginx.pid; with daemon off; in /etc/nginx/nginx.conf
I, [2021-02-12T14:17:46.587071 #1]  INFO -- : Replacing (?m-ix:upstream[^\}]+\}) with upstream discourse { server 127.0.0.1:3000; } in /etc/nginx/conf.d/discourse.conf
I, [2021-02-12T14:17:46.587476 #1]  INFO -- : Replacing (?-mix:server_name.+$) with server_name _ ; in /etc/nginx/conf.d/discourse.conf
I, [2021-02-12T14:17:46.603447 #1]  INFO -- : Replacing (?-mix:client_max_body_size.+$) with client_max_body_size $upload_size ; in /etc/nginx/conf.d/discourse.conf
I, [2021-02-12T14:17:46.679624 #1]  INFO -- : > echo "done configuring web"
I, [2021-02-12T14:17:46.682047 #1]  INFO -- : done configuring web
I, [2021-02-12T14:17:46.682561 #1]  INFO -- : > cd /var/www/discourse && gem update bundler
I, [2021-02-12T14:17:53.098565 #1]  INFO -- : Updating installed gems
I, [2021-02-12T14:17:53.098690 #1]  INFO -- : > cd /var/www/discourse && find /var/www/discourse ! -user discourse -exec chown discourse {} \+
I, [2021-02-12T14:22:54.825495 #1]  INFO -- :
I, [2021-02-12T14:22:54.826652 #1]  INFO -- : > cd /var/www/discourse && su discourse -c 'bundle install --deployment --retry 3 --jobs 4 --verbose --without test development'
I, [2021-02-12T14:24:47.161455 #1]  INFO -- : Running `bundle install --deployment --jobs 4 --retry 3 --verbose --without "test" "development"` with bundler 2.2.9
I, [2021-02-12T14:24:47.162270 #1]  INFO -- : > cd /var/www/discourse && su discourse -c 'bundle exec rake plugin:pull_compatible_all'
I, [2021-02-12T14:25:19.993529 #1]  INFO -- : discourse-spoiler-alert is already at latest compatible version
I, [2021-02-12T14:25:19.994069 #1]  INFO -- : > cd /var/www/discourse && su discourse -c 'bundle exec rake db:migrate'
I, [2021-02-12T14:25:59.683204 #1]  INFO -- :
I, [2021-02-12T14:25:59.683442 #1]  INFO -- : > cd /var/www/discourse && su discourse -c 'bundle exec rake themes:update assets:precompile'
I, [2021-02-12T14:26:04.560560 #4880]  INFO -- : Writing /var/www/discourse/public/assets/vendor-cbd6e0773a348bdfe5771d26f9eb195929c0b36a2c09bdca0b903edd080428bc.js
I, [2021-02-12T14:26:12.841565 #4880]  INFO -- : Writing /var/www/discourse/public/assets/admin-9b518093f4c20ef95f264bc28e10318110e8741afad865dbf76a424d69d28ccc.js
I, [2021-02-12T14:26:12.847920 #4880]  INFO -- : Writing /var/www/discourse/public/assets/browser-detect-115ab5953de1b5bb122bfb26b757f5391dd8d1d2aef2b81baf7b59aee99d9f34.js
I, [2021-02-12T14:26:12.851936 #4880]  INFO -- : Writing /var/www/discourse/public/assets/browser-update-92cd9b3599f62ca785b6cbf3d8d3afb080d6cd463034e2fccefd5455b0f5fff6.js
I, [2021-02-12T14:26:12.855958 #4880]  INFO -- : Writing /var/www/discourse/public/assets/break_string-cc617154cd957804f2f6a1f3bc68258c9cdca3d4b9a322bf777d145fed04790e.js
I, [2021-02-12T14:26:19.583102 #4880]  INFO -- : Writing /var/www/discourse/public/assets/ember_jquery-36a23101c869ab0dc53fc908de69adb785731593573d32bdeef416acc1076ef4.js
I, [2021-02-12T14:26:20.759892 #4880]  INFO -- : Writing /var/www/discourse/public/assets/pretty-text-bundle-f07dfa9b2ec7ca83cf749b3959b4ca595f90fecb33c6793a6eecad166fee7bf7.js
I, [2021-02-12T14:26:23.608879 #4880]  INFO -- : Writing /var/www/discourse/public/assets/wizard-application-bacd9e817bd7491e1d278d8511370f86b9a6bcf91cee3ad039b3b2f3a116d474.js
I, [2021-02-12T14:26:23.660357 #4880]  INFO -- : Writing /var/www/discourse/public/assets/wizard-vendor-9a4c01e35fad22133b0dc5896b2bd1fde538bc03f51828485c8598ec260f3936.js
I, [2021-02-12T14:26:24.204929 #4880]  INFO -- : Writing /var/www/discourse/public/assets/markdown-it-bundle-04999a8c1ce5e0e2544244cf2303c4383d8aaae90f8446b875a9724470a9aca3.js
I, [2021-02-12T14:26:24.213263 #4880]  INFO -- : Writing /var/www/discourse/public/assets/service-worker-c05179ef4f55c98f86ca3a3fc55a80e84994fc0400de1de7748481441e8c973a.js
I, [2021-02-12T14:26:24.233191 #4880]  INFO -- : Writing /var/www/discourse/public/assets/google-tag-manager-fa22e2f6e90054a789e680fd7c9357cb322d817c193d4a71af296db9dfe3e26e.js
I, [2021-02-12T14:26:24.241857 #4880]  INFO -- : Writing /var/www/discourse/public/assets/google-universal-analytics-v3-706f1d28f0a97f67a47515c96189277240ec4940d968955042066d7873fd1fe8.js
I, [2021-02-12T14:26:24.249514 #4880]  INFO -- : Writing /var/www/discourse/public/assets/google-universal-analytics-v4-3f290b57b4e029da9e59f074043a0c8e816f099ef4ccffe82b821ff43e9a4c7f.js
I, [2021-02-12T14:26:24.255874 #4880]  INFO -- : Writing /var/www/discourse/public/assets/start-discourse-efa4e5abfbd1b50b5152ffbe64d5dcea9f7c33f766dcc6387e2711f0f2112148.js
I, [2021-02-12T14:26:24.259925 #4880]  INFO -- : Writing /var/www/discourse/public/assets/print-page-e36056a4075e3fd3032cbf30b45aa1ce743abe55bf79f9e92429f33446f0801b.js
I, [2021-02-12T14:26:24.271846 #4880]  INFO -- : Writing /var/www/discourse/public/assets/activate-account-a1f1c2df02186f5182c09abcba45827d0284071678fabffc91ef23b17add35bb.js
I, [2021-02-12T14:26:24.281874 #4880]  INFO -- : Writing /var/www/discourse/public/assets/auto-redirect-4629c3e3258ec7a5a9aafe3dc77db2bdaa15db2ac68275e549bdb0e708643e34.js
I, [2021-02-12T14:26:24.289439 #4880]  INFO -- : Writing /var/www/discourse/public/assets/wizard-start-f142a86a7c6379e363875dc55b832b2c0ecd6d59c391af4c9d00ff34e41f9ed0.js
I, [2021-02-12T14:26:24.295276 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/i18n-ea49fc7729180d7e43506b7ca9377c9129ebbcf1c61060c4e1f5fdaf86c92bdd.js
I, [2021-02-12T14:26:24.322373 #4880]  INFO -- : Writing /var/www/discourse/public/assets/discourse/app/lib/webauthn-af17e0b522e5257259b9c2c0184e981c801abe039c011748207076c40ab52d72.js
I, [2021-02-12T14:26:24.337606 #4880]  INFO -- : Writing /var/www/discourse/public/assets/confirm-new-email/confirm-new-email-35282b052451b4a25beca1667e4cf7ce022121f8d2107a078251a042e9c38419.js
I, [2021-02-12T14:26:24.347765 #4880]  INFO -- : Writing /var/www/discourse/public/assets/confirm-new-email/bootstrap-52b6b6b3fa62d64b09775e2803255326bef3a94a16063a8c191a37e0909f59d1.js
I, [2021-02-12T14:26:24.358913 #4880]  INFO -- : Writing /var/www/discourse/public/assets/onpopstate-handler-417528e7d5f1058afdf6002e7606a3f51c2abc04573b72c85a24374a343448f2.js
I, [2021-02-12T14:26:24.373582 #4880]  INFO -- : Writing /var/www/discourse/public/assets/embed-application-9cef8308c816fc1d83137e63d6c556c6cc2b68fe2b6e5ce16cca6766ba2c0ae4.js
I, [2021-02-12T14:26:24.614865 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/en-20da23b402709f304c044bb48d1526ec7209d0b78680e7e15778cbe1e16e1b7c.js
I, [2021-02-12T14:26:24.897846 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/zh_TW-1c69366e34fd9f5da19231eeb4e5c7a726d991bd39982be4574ddc98484da539.js
I, [2021-02-12T14:26:25.097500 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/et-d45401d4ffa5f3b2af0c15baee2335b7b872801a31211d8dc7defdbd535e91ca.js
I, [2021-02-12T14:26:25.371642 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/he-7df2aa3d2858820c59456098e50843d524ce08077afebd14fd3554f61f6b9862.js
I, [2021-02-12T14:26:25.608644 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/de-2201ed74f2cc8283f203d9ac3e75d25b4249d11274c1ef4798d5651d30288f7a.js
I, [2021-02-12T14:26:25.810520 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/da-c1afeed3143ff90d44caaad578167348854de6a0ad2ed720b0e3a1f01b77056b.js
I, [2021-02-12T14:26:25.996483 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/sk-18299d6d2734755f43e203f78da8667fd44e7d3f743d1fae6e42454840c97ba8.js
I, [2021-02-12T14:26:26.228985 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/sv-3965bf11b720e2b8c3e24d2b7f9d57a4ad7b5e8d7becdb419b3009b2cbda5ec5.js
I, [2021-02-12T14:26:26.441453 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/fi-b58320fff56953f6cf26e71d509b10a4479e43ccc455ed2c33e61f4ffdd7c6ac.js
I, [2021-02-12T14:26:26.629819 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/lt-9b0f5015bb99dd73d26cc262a4fa50089dc547a308484f16e63048e78909f82a.js
I, [2021-02-12T14:26:26.835676 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/nb_NO-c765263283aad4b6d537b420e125108388928d4263f40dbca28e0d9d96105033.js
I, [2021-02-12T14:26:27.043397 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/pt_BR-d1740a9fe5f812742d71ac8ba5d613463a862f9eee80f1c549af39b8ce0bfe0a.js
I, [2021-02-12T14:26:27.240127 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/pt-14a64a296ab17b392a90248f6f07c6389c85b1bee1191b303053cebcaa888e56.js
I, [2021-02-12T14:26:27.457280 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/cs-42a32eb8bf11a877a3c644add58daa6f900fd101332126864ee4afdc4b80061b.js
I, [2021-02-12T14:26:27.766077 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/it-b5f10a9d89b846ce99b9ab1a8da9e336944493e34713e7f8826b87e2f2cf1911.js
I, [2021-02-12T14:26:28.482575 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/th-d9163c19536523928579bade16336ad99aca4f8dff332b57d281f811d5a5e16e.js
I, [2021-02-12T14:26:28.733516 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/ro-be981f3f9fb1961c3c64588faac14804f60664f19e7ef9ef3baef4cbd218ee3f.js
I, [2021-02-12T14:26:28.920613 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/sq-52409d5632388e2fa23616ffccd182ba6fb23a84ad0823c7bd02ae897eb90eb5.js
I, [2021-02-12T14:26:29.177666 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/ar-b12c0be791a6642df69803c1c486540d87eab64bc0536bc1ec50818f01641e89.js
I, [2021-02-12T14:26:29.421417 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/fa_IR-dcb32ab59d1da09c5f977bff795bfecc272704554560107d441a4d2a89cb6ff8.js
I, [2021-02-12T14:26:29.619720 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/te-0768f34951cbc0597301cac514bf81de1e0c005fdc2ff5e1a9419411c4e5116d.js
I, [2021-02-12T14:26:29.834450 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/ur-fe8a89865a0208912ff99912cfe21bdae91a8adbc700a9fe970a06c9efbdf9a1.js
I, [2021-02-12T14:26:30.047313 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/bs_BA-7704878b63f43f12c3a27842ab2d47adea30cfb7a8ce904d25376db57d83d720.js
I, [2021-02-12T14:26:30.252620 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/es-784711aac09356e57d3733d17896462d9c40fff031219fd718e7803330fe8dbe.js
I, [2021-02-12T14:26:30.487958 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/el-8641de917992b34ee34681702a3bc80a224c0f532fa37bd3c5e61b5d1dfd2340.js
I, [2021-02-12T14:26:30.673178 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/id-2a4d901a1f32a915cee6bfa1189bd2845aa5c68eaa4580b094b7cff0ae3775ab.js
I, [2021-02-12T14:26:30.888713 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/nl-ee34dab800d700bc32a806da1662cc16bf56004e9875b5c32c08a18d81922224.js
I, [2021-02-12T14:26:31.207112 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/fr-e827308400f67a788b7e717b4d6213c7ff896b5aeca51b167df9be7862ac3f30.js
I, [2021-02-12T14:26:31.528660 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/ru-08adc2653eaa49cab733aaa6854ee93ca2c7fa971143d9e052251a5891bb8de0.js
I, [2021-02-12T14:26:31.776351 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/uk-f821c8dc163dd23ed01e9e39cb4fee406ef726b5abca8fc4ab1c8d52889c433c.js
I, [2021-02-12T14:26:31.979736 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/zh_CN-44df73efd38f81addd66ba60c73b21562fe5d98a7cdba799a65c8ff15b98f714.js
I, [2021-02-12T14:26:32.178912 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/ja-5b38b3748434220f8f3c3e3b29ca7d183fe323eaeffc05c13066e50d588d5185.js
I, [2021-02-12T14:26:32.361794 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/lv-3cf532ea9df4501c0b1e22b5889d5e1fbcb37a4e99b337e12cfc18364e405c61.js
I, [2021-02-12T14:26:32.564658 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/tr_TR-9d40b21e147b2b0df91cf1ca5b43a41a7931554ed7a36e64c9ab44019e4d1470.js
I, [2021-02-12T14:26:32.789210 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/pl_PL-d14596b55e67ae1e55e53d7d67661ce89bfbaea1f79a00ccd0e505bb034e0485.js
I, [2021-02-12T14:26:32.982027 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/hu-fb69991d2236877503444bf48d283c3aaed09d3d236c8b1a107bc65fe80980f2.js
I, [2021-02-12T14:26:33.244588 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/bg-ca03268f3575636c0ed5a05a5bb44324bef82872e57918b861c2babd33b75733.js
I, [2021-02-12T14:26:33.443152 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/sl-8a83b6b3e9697b9bb1bdaa05f12e928dc1b4d7bb504bcfb5cf127bc0a5cd5f9d.js
I, [2021-02-12T14:26:33.661673 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/gl-72ff8659006c8eda7a3562e45045bbf5ac4cf69e9132b2269277cd78499b36e8.js
I, [2021-02-12T14:26:33.913591 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/sw-cb374ffb9122f97c564c913bc02f743bc77081729c7927da794c616e16e620a9.js
I, [2021-02-12T14:26:34.255245 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/vi-50058b2c18cec141c7cbc1e6c4b08982e6a9991727add207fa6f804ebe813d2b.js
I, [2021-02-12T14:26:34.505375 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/hy-16dc4fb9234442e404351cc782b64771f8a239dcacd29214d086bb39dc6c321d.js
I, [2021-02-12T14:26:34.723535 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/ca-82930fb7a7f128e844d71693903745fc52371ce48fb049832d6d0624de8f8b5a.js
I, [2021-02-12T14:26:34.905840 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/be-96a5f9e2ada7781d23953767acfaf31e0910205bef176603ef983d0d8dae28c9.js
I, [2021-02-12T14:26:35.087048 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/sr-6c9c4abf4f6f272d877119dda816297752f50bab7687f70c6ec28cc73f66bb8b.js
I, [2021-02-12T14:26:35.281229 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/ko-2375b0b576cc1848c0dcf303891a2edd6278c0fd70b082bf07b159e837871545.js
I, [2021-02-12T14:26:35.435334 #4880]  INFO -- : Writing /var/www/discourse/public/assets/locales/en_GB-30c5baa998778b956eaa9ddfe1d552ebcbdf9680c93c90f8fa6d566c6c8641ab.js
I, [2021-02-12T14:26:35.447016 #4880]  INFO -- : Writing /var/www/discourse/public/assets/docker-manager-app-5c1a220b23e0afaccd100a14bca77a38de5520361fc84294195060946b019e25.js
I, [2021-02-12T14:26:35.982603 #4880]  INFO -- : Writing /var/www/discourse/public/assets/docker-manager-app-614579ae5251889ca5e969015bf9ca949b7956ba0526e62a25211c3d09a6b721.css
I, [2021-02-12T14:26:36.145613 #4880]  INFO -- : Writing /var/www/discourse/public/assets/docker-manager-vendor-9709990270a4ade37544c98dda3cfad18f77cdf6cd433291c3c5ef7bd25cb50d.js
I, [2021-02-12T14:26:36.151071 #4880]  INFO -- : Writing /var/www/discourse/public/assets/docker-manager-vendor-e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.css
I, [2021-02-12T14:26:36.155783 #4880]  INFO -- : Writing /var/www/discourse/public/assets/images/docker-manager-aff8eaea0445c0488c19f8cfd14faa8c2b278924438f19048eacc175d7d134e4.png
I, [2021-02-12T14:26:36.568407 #4880]  INFO -- : Writing /var/www/discourse/public/assets/plugins/discourse-chat-integration-888e776293e20f1db62f4d0b044aec250a2a07aa6a638c7f1ec7dca47c33f3dc.js
I, [2021-02-12T14:26:36.599931 #4880]  INFO -- : Writing /var/www/discourse/public/assets/plugins/discourse-details-9be9806ef2338ede8e5c567dfd5b521aaad27d01694f01c604516118466d2120.js
I, [2021-02-12T14:26:37.010425 #4880]  INFO -- : Writing /var/www/discourse/public/assets/plugins/discourse-local-dates-085df7b6d1a298c1715bebab5b6a4611defbce5de303a87abf7d627bae61fffb.js
I, [2021-02-12T14:26:37.110534 #4880]  INFO -- : Writing /var/www/discourse/public/assets/plugins/discourse-math-098a79094dfd8c2dc3e54bd4d314669578c0ebc8756d18211c4e84f5c96443d5.js
I, [2021-02-12T14:26:37.134782 #4880]  INFO -- : Writing /var/www/discourse/public/assets/plugins/discourse-narrative-bot-0b1e40d099d739cee23bbad45c2fb5eac1dcaaba028fdc9fa21b9e32930ec40b.js
I, [2021-02-12T14:26:37.286429 #4880]  INFO -- : Writing /var/www/discourse/public/assets/plugins/discourse-presence-0165b3e3b684abf51b52c5170936daf0ef0a445070af773586dc3636f90f957d.js
I, [2021-02-12T14:26:37.415777 #4880]  INFO -- : Writing /var/www/discourse/public/assets/plugins/discourse-solved-d8a57b639c6586da7ebca0416be123fe4e9b1d7365543d14186f2b89a56d9b6a.js
I, [2021-02-12T14:26:37.478806 #4880]  INFO -- : Writing /var/www/discourse/public/assets/plugins/discourse-spoiler-alert-88fd1a561e59e7197797c0c4f0a000254e87ce58e6a4136dbc0daacad1e85b7e.js
I, [2021-02-12T14:26:37.498902 #4880]  INFO -- : Writing /var/www/discourse/public/assets/plugins/docker_manager-ad177f91e75af171560e0d79a81bd5ce7b5b01c80c9055a24d75e9370c9de28b.js
I, [2021-02-12T14:26:37.516247 #4880]  INFO -- : Writing /var/www/discourse/public/assets/plugins/lazy-yt-9db193c8caacf2e3b3a24ed4c63699ad497c210f668f467d95380efd00982345.js
I, [2021-02-12T14:26:40.601499 #4880]  INFO -- : Writing /var/www/discourse/public/assets/plugins/poll-b5418ac0c8943ba9a386a1332a42d8ba0a8f4173023239b09b8d9bdd08f3a11f.js
I, [2021-02-12T14:26:40.981609 #4880]  INFO -- : Writing /var/www/discourse/public/assets/plugins/styleguide-03523511cd853ca8572bd93886d4a7be217da71cfdb7f7c246ccba982c8ab11c.js
I, [2021-02-12T14:27:27.135153 #4880]  INFO -- : Writing /var/www/discourse/public/assets/application-81c1e81c85d7a88a679efa7269e7ef14acc80ee972df2e1b7ecdb564c76bdb52.js
I, [2021-02-12T14:27:27.139301 #4880]  INFO -- : Writing /var/www/discourse/public/assets/favicon-24b22a63aae0cf353d72b6b728504377bfc42edc6563f202e3a1401763497249.ico
I, [2021-02-12T14:27:27.142644 #4880]  INFO -- : Writing /var/www/discourse/public/assets/favicons/amazon-32233ce06b62096ce24f7e6a87a466972e0fbaab4df8c0b8c080abb331893d9f.png
I, [2021-02-12T14:27:27.145297 #4880]  INFO -- : Writing /var/www/discourse/public/assets/favicons/apple-37604b02a18539464c2af0ac2e88aa910172eb41ac295fb252fa9df490052cf4.png
I, [2021-02-12T14:27:27.149399 #4880]  INFO -- : Writing /var/www/discourse/public/assets/favicons/discourse-2c77f44366f7981baebf4ecad9b30060bd82a296967466a5d65e7fa042e7e31b.png
I, [2021-02-12T14:27:27.152399 #4880]  INFO -- : Writing /var/www/discourse/public/assets/favicons/github-766534fc8cb40a67bf050bd084db1151f1a5c6879675f281f5f1cb51eb1a31c8.png
I, [2021-02-12T14:27:27.157349 #4880]  INFO -- : Writing /var/www/discourse/public/assets/favicons/google_branding/logo_calendar_128px-f426f7f40ccb7f7f07cc473cbebb291664506356dd56d9d43953d76664a2d957.png
I, [2021-02-12T14:27:27.161113 #4880]  INFO -- : Writing /var/www/discourse/public/assets/favicons/google_branding/logo_calendar_48px-f2530faed46d5e34385114c3ff3eee0e6098a1c68247e1e85f99054de506a627.png
I, [2021-02-12T14:27:27.165911 #4880]  INFO -- : Writing /var/www/discourse/public/assets/favicons/google_branding/logo_docs_48px-9a05553acfa99570b278d07f18fec279a3bc6ef2063fef9864b22da68b30f4da.png
I, [2021-02-12T14:27:27.169086 #4880]  INFO -- : Writing /var/www/discourse/public/assets/favicons/google_branding/logo_drive_48px-2f4ea1916b1916d5714cd3ff95ad584d3aaa6711be4eb107e1988efa073ee2e0.png
I, [2021-02-12T14:27:27.172358 #4880]  INFO -- : Writing /var/www/discourse/public/assets/favicons/google_branding/logo_forms_48px-a30e9255c6ee0f4da85576b3ab79b5f0bbb4f9cf5f7116b5939aba29c40b3d6c.png
I, [2021-02-12T14:27:27.177946 #4880]  INFO -- : Writing /var/www/discourse/public/assets/favicons/google_branding/logo_sheets_48px-9e96b7743ed1765c6a8d05f06f9035173dfd0b457663c5bb305ecba4cc98c19e.png
I, [2021-02-12T14:27:27.181739 #4880]  INFO -- : Writing /var/www/discourse/public/assets/favicons/google_branding/logo_slides_48px-50876957878e9afa9c68a8f1a28d2d01d18645a6c5670c5b412ce335b0a61f09.png
I, [2021-02-12T14:27:27.185100 #4880]  INFO -- : Writing /var/www/discourse/public/assets/favicons/google_play-128adb4c5cfa76a15b1b4c8afbb4a2db5503f79ce58f28b17a1dbab20f83697b.png
I, [2021-02-12T14:27:27.188679 #4880]  INFO -- : Writing /var/www/discourse/public/assets/favicons/instagram-c11e16559e70f974a3c52186c9fdefa4debc653d60def1be1196c0add54598aa.png
I, [2021-02-12T14:27:27.191901 #4880]  INFO -- : Writing /var/www/discourse/public/assets/favicons/pdf_48px-11e5b37a9b8e941eee7da4eff572525fa7a872dea8ac0325531d4e4831ee5448.png
I, [2021-02-12T14:27:27.194438 #4880]  INFO -- : Writing /var/www/discourse/public/assets/favicons/pdf_64px-c7451be3289fe894e1b84be566f57e96fd7339249974a831aa74dd7b21351f68.png
I, [2021-02-12T14:27:27.196722 #4880]  INFO -- : Writing /var/www/discourse/public/assets/favicons/rottentomatoes-d65e8ee6b0ae4302aecacc6ffeefb284bf4efba93c4049faadaab55759ecc833.png
I, [2021-02-12T14:27:27.200802 #4880]  INFO -- : Writing /var/www/discourse/public/assets/favicons/stackexchange-d4476e9e7947492e31563225692eb35f25ffb5073773e20d334f94fce85648ac.png
I, [2021-02-12T14:27:27.204005 #4880]  INFO -- : Writing /var/www/discourse/public/assets/favicons/twitter-2563ce2cc8e6b20d97b05ef7de1f03204bb4263e50815b0d4e6a932acb690e32.png
I, [2021-02-12T14:27:27.207075 #4880]  INFO -- : Writing /var/www/discourse/public/assets/favicons/wikipedia-8feddaf7544a35c824f2e4274227fe8e7e7af71ddfe26523fe5fe20497cf5799.png
I, [2021-02-12T14:27:27.211641 #4880]  INFO -- : Writing /var/www/discourse/public/assets/logo-dev-0b53838dc1ee09248b94e3d4aa5c70d4a9897f26b8133d147e17bf8d41d3be7b.png
I, [2021-02-12T14:27:27.215388 #4880]  INFO -- : Writing /var/www/discourse/public/assets/logo-single-dev-5545f7e0d4d1d1d5ba821a6d8c1e394033558324e90acc1c6045cf382b4880c8.png
I, [2021-02-12T14:27:27.218750 #4880]  INFO -- : Writing /var/www/discourse/public/assets/logo-single-d7a0dacc998273856c42737dba8693fbdb9e5fd929d36afeb3f13844f147e865.png
I, [2021-02-12T14:27:27.222009 #4880]  INFO -- : Writing /var/www/discourse/public/assets/logo-ba2f2da6eac779d8b34d4aa977be739e4de07f7d34e970f4b8ac32682706c122.png
I, [2021-02-12T14:27:27.226868 #4880]  INFO -- : Writing /var/www/discourse/public/assets/push-notifications/check-f64a79b1bde9a9e1f6fdc1ab382163596a06e3ae71443bb8c8231aa595bcbc80.png
I, [2021-02-12T14:27:27.230281 #4880]  INFO -- : Writing /var/www/discourse/public/assets/push-notifications/discourse-bdbc548a4e328f39b017bb143b679c5dfe7b060574760cd71d77971c2a9eff1f.png
I, [2021-02-12T14:27:27.233295 #4880]  INFO -- : Writing /var/www/discourse/public/assets/push-notifications/group_mentioned-012ba348812e600c5532b8ccc08e8767b16fd126f3c7bcedcbdedaba640721d6.png
I, [2021-02-12T14:27:27.236377 #4880]  INFO -- : Writing /var/www/discourse/public/assets/push-notifications/linked-02191f88212f5cba22760235346da4e238eb9a4c9056cac92965a940eeaa02d0.png
I, [2021-02-12T14:27:27.240089 #4880]  INFO -- : Writing /var/www/discourse/public/assets/push-notifications/mentioned-012ba348812e600c5532b8ccc08e8767b16fd126f3c7bcedcbdedaba640721d6.png
I, [2021-02-12T14:27:27.242761 #4880]  INFO -- : Writing /var/www/discourse/public/assets/push-notifications/posted-918b5c4333d62ea140dfc63a49d1ee60e71f00418b8f2f7fa91bb65a2c995830.png
I, [2021-02-12T14:27:27.245471 #4880]  INFO -- : Writing /var/www/discourse/public/assets/push-notifications/private_message-77576c8c5017882f813792be99ee57b2ddaa417c2baf74255a9899867ad66b97.png
I, [2021-02-12T14:27:27.248953 #4880]  INFO -- : Writing /var/www/discourse/public/assets/push-notifications/quoted-a1bf4d7b4f4ad6b34b43d60143a7e07ddc030855eae2cf9308011ba91a3ce168.png
I, [2021-02-12T14:27:27.251945 #4880]  INFO -- : Writing /var/www/discourse/public/assets/push-notifications/replied-918b5c4333d62ea140dfc63a49d1ee60e71f00418b8f2f7fa91bb65a2c995830.png
I, [2021-02-12T14:27:27.255640 #4880]  INFO -- : Writing /var/www/discourse/public/assets/select2-spinner-167ca7c36c01a1e1ea29b6dc5ff154e0f5d1669e69ee7c2fd33e6f2f8bed9dce.gif
I, [2021-02-12T14:27:27.258474 #4880]  INFO -- : Writing /var/www/discourse/public/assets/select2-989b6d7958f96d9200676011d0784973a28290f24a33fa8bb11c99a3bdb17d45.png
I, [2021-02-12T14:27:27.261202 #4880]  INFO -- : Writing /var/www/discourse/public/assets/select2x2-4716447f68b44b59597bbc4ae471e5ed849873309fbaa689ae26b69494cc2ae3.png
I, [2021-02-12T14:27:27.263991 #4880]  INFO -- : Writing /var/www/discourse/public/assets/spinner_96-2aa4bebb9cae6fdb5cd0f962da0d86f9370606fbcb52156b1416fe194c110f8f.gif
I, [2021-02-12T14:27:27.281050 #4880]  INFO -- : Writing /var/www/discourse/public/assets/admin/package-9999be639c39a529092f53101c8b8ef21c32d5a572a396b0804cbe1f602ca60d.json
I, [2021-02-12T14:27:27.336917 #4880]  INFO -- : Writing /var/www/discourse/public/assets/discourse/app/index-f8ba3cfadff66bd3faa8ae0122e0ef33e6336bedbffe9c1ca2e482a64fe7d909.html
I, [2021-02-12T14:27:27.347281 #4880]  INFO -- : Writing /var/www/discourse/public/assets/discourse/config/optional-features-686dfa136f902425f302ca150899f1476f216a8318593e81c73e05c1d274c8de.json
I, [2021-02-12T14:27:27.349410 #4880]  INFO -- : Writing /var/www/discourse/public/assets/discourse/package-0ad2fe0fb1145c4f89dcbd77e3af4ea4bceeff488548e0acfdafee538bbc911c.json
I, [2021-02-12T14:27:27.356964 #4880]  INFO -- : Writing /var/www/discourse/public/assets/discourse/tests/index-4dd02b56e1105f7c9909f24dd98baa225b8d193b39278561064513adc52ac0e4.html
I, [2021-02-12T14:27:27.366172 #4880]  INFO -- : Writing /var/www/discourse/public/assets/discourse/yarn-fe3ee940fdf3218165ac72714167cf92e8fb5cd2a2cad2a9e8e9bf8c7f723f58.lock
I, [2021-02-12T14:27:27.369252 #4880]  INFO -- : Writing /var/www/discourse/public/assets/discourse-common/package-76394df51a9d2dde9907bcac46e31d9bacddc04a1944ec759791d0f6cb7745cb.json
I, [2021-02-12T14:27:27.373394 #4880]  INFO -- : Writing /var/www/discourse/public/assets/discourse-common/yarn-1f9507dfae63854c638a6a2b81927aa37402324e3e12d80493b8dfe16635caba.lock
I, [2021-02-12T14:27:27.376016 #4880]  INFO -- : Writing /var/www/discourse/public/assets/discourse-hbr/package-2050287607b31f70fd128a68f5800256e1ce6ee837095733d2f6c5ae13d25502.json
I, [2021-02-12T14:27:27.380368 #4880]  INFO -- : Writing /var/www/discourse/public/assets/discourse-hbr/yarn-bd8529534fccb0d05ae1acb7b46239ee3f8028a3688cc938d00e490535e61f9a.lock
I, [2021-02-12T14:27:27.383353 #4880]  INFO -- : Writing /var/www/discourse/public/assets/discourse-widget-hbs/package-3c02f717bcfb75c715ea40cc367668562f4336d921fc4d8258c3375276c87db4.json
I, [2021-02-12T14:27:27.387599 #4880]  INFO -- : Writing /var/www/discourse/public/assets/discourse-widget-hbs/yarn-d65a2ff4665f81d7ae1ec95a890e39ca96841104840d6cbe110779317c9e00eb.lock
I, [2021-02-12T14:27:27.390155 #4880]  INFO -- : Writing /var/www/discourse/public/assets/docs/yuidoc-d4a0515b77168bf39e922e83e51c6c53e4d0d026424d18632579fb780e62823d.json
I, [2021-02-12T14:27:27.393090 #4880]  INFO -- : Writing /var/www/discourse/public/assets/package-92a050046ac558d34f2e54442755c280e5f18397d099a776e95079be5b2539ad.json
I, [2021-02-12T14:27:27.396282 #4880]  INFO -- : Writing /var/www/discourse/public/assets/pretty-text/package-ba946b9dced6a4ff28f8499707edd3781c1db8047fcc77df5bc16cf29a430b56.json
I, [2021-02-12T14:27:27.400513 #4880]  INFO -- : Writing /var/www/discourse/public/assets/pretty-text/yarn-afb1e44bb91225a114ffec9e5b5153cb456ba4061f1d6f17a7cefc8e2f320619.lock
I, [2021-02-12T14:27:27.404636 #4880]  INFO -- : Writing /var/www/discourse/public/assets/select-kit/package-49daa780536292224da02a386e07c1b65ad91d28be297eb7beeaeff3564e56b1.json
I, [2021-02-12T14:27:27.408805 #4880]  INFO -- : Writing /var/www/discourse/public/assets/select-kit/yarn-2d623b95679464de1222583382d58440f4b4073b10fc05ebb54bdbe950a5165c.lock
I, [2021-02-12T14:27:27.442574 #4880]  INFO -- : Writing /var/www/discourse/public/assets/yarn-0985ac9e835fdbe37c992d1f49ba7f8e3ab7ca87550a8f95c1e9ae51938c9c4a.lock
I, [2021-02-12T14:29:17.967881 #1]  INFO -- : Downloading MaxMindDB...
I, [2021-02-12T14:29:17.975400 #1]  INFO -- : File > /usr/local/bin/discourse  chmod: +x  chown:
I, [2021-02-12T14:29:17.981262 #1]  INFO -- : File > /usr/local/bin/rails  chmod: +x  chown:
I, [2021-02-12T14:29:17.987177 #1]  INFO -- : File > /usr/local/bin/rake  chmod: +x  chown:
I, [2021-02-12T14:29:17.992784 #1]  INFO -- : File > /usr/local/bin/rbtrace  chmod: +x  chown:
I, [2021-02-12T14:29:17.998147 #1]  INFO -- : File > /usr/local/bin/stackprof  chmod: +x  chown:
I, [2021-02-12T14:29:19.521797 #1]  INFO -- : File > /etc/update-motd.d/10-web  chmod: +x  chown:
I, [2021-02-12T14:29:19.548414 #1]  INFO -- : File > /etc/logrotate.d/rails  chmod:   chown:
I, [2021-02-12T14:29:19.551930 #1]  INFO -- : File > /etc/logrotate.d/nginx  chmod:   chown:
I, [2021-02-12T14:29:19.557738 #1]  INFO -- : File > /etc/runit/1.d/00-ensure-links  chmod: +x  chown:
I, [2021-02-12T14:29:19.563283 #1]  INFO -- : File > /etc/runit/1.d/01-cleanup-web-pids  chmod: +x  chown:
I, [2021-02-12T14:29:19.568391 #1]  INFO -- : File > /root/.bash_profile  chmod: 644  chown:
I, [2021-02-12T14:29:19.571660 #1]  INFO -- : File > /usr/local/etc/ImageMagick-7/policy.xml  chmod:   chown:
I, [2021-02-12T14:29:19.572062 #1]  INFO -- : Replacing (?-mix:server.+{) with limit_req_zone $binary_remote_addr zone=flood:10m rate=$reqs_per_secondr/s;
I, [2021-02-12T14:29:19.572513 #1]  INFO -- : Replacing (?-mix:location @discourse {) with location @discourse {
I, [2021-02-12T14:29:19.617473 #1]  INFO -- : File > /etc/runit/1.d/remove-old-socket  chmod: +x  chown:
I, [2021-02-12T14:29:19.622824 #1]  INFO -- : File > /etc/runit/3.d/remove-old-socket  chmod: +x  chown:
I, [2021-02-12T14:29:19.623035 #1]  INFO -- : Replacing (?-mix:listen 80;) with listen unix:/shared/nginx.http.sock;
I, [2021-02-12T14:29:19.646385 #1]  INFO -- : Replacing (?-mix:listen 443 ssl http2;) with listen unix:/shared/nginx.https.sock ssl http2;
I, [2021-02-12T14:29:19.700427 #1]  INFO -- : > echo "Beginning of custom commands"
I, [2021-02-12T14:29:19.702743 #1]  INFO -- : Beginning of custom commands
I, [2021-02-12T14:29:19.703200 #1]  INFO -- : > echo "End of custom commands"
I, [2021-02-12T14:29:19.705306 #1]  INFO -- : End of custom commands
I, [2021-02-12T14:29:19.705598 #1]  INFO -- : Terminating async processes
I, [2021-02-12T14:29:19.705780 #1]  INFO -- : Sending INT to HOME=/var/lib/postgresql USER=postgres exec chpst -u postgres:postgres:ssl-cert -U postgres:postgres:ssl-cert /usr/lib/postgresql/13/bin/postmaster -D /etc/postgresql/13/main pid: 50

Looking at the proxmox information for the VM, the ram seems ok, the cpu seems ok:

Overgrow · February 12, 2021, 3:30pm

Very, very slow chowns… seems like a really slow disk.

I, [2021-02-12T14:17:53.098690 #1]  INFO -- : > cd /var/www/discourse && find /var/www/discourse ! -user discourse -exec chown discourse {} \+
I, [2021-02-12T14:22:54.825495 #1]  INFO -- :

pfaffman · February 12, 2021, 3:46pm

If that’s the case, changing the git clone to sudo discourse as described in the Install Plugins in Discourse might save a bit of time. But if the disks are spinning pieces of metal, that’s the problem.

Falco · February 12, 2021, 6:23pm

Yes. A slow server will have slower rebuild times like this.

Some steps are, but not all. That said, a single core means sharing the CPU between the multiple processes the container have, and will be even worse when trying to serve traffic. So if you can afford it’s better to add some cores.

Topic		Replies	Views
Discourse won't rebuild Installation	4	883	September 6, 2021
Rebuild fails during upgrade due to `discourse-github` plugin Installation	8	1669	March 10, 2020
Discourse bundle exec rake multisite:migrate failed Bug	5	1410	March 12, 2021
Problem after Discourse update Installation	17	1590	March 8, 2021
Error when "./discourse rebuild app" due to theme error Installation	6	1649	December 1, 2021

Slow Discourse Rebuild on a VM with slow disks

Related topics