The forum is down and when I try to upgrade docker I get this error:
./launcher rebuild app doesn’t work, as it was what made the forum go down in the first place (maybe a bad upgrade procedure?). I’m afraid the docker install is corrupted somehow and the data is lost. I have regular backups, but I still don’t want to lose what I had.
I think the “ignoring file…” bit is a red herring and not at all related to the problem. /etc/apt/apt.conf.d/50unattended-upgrades is a regular Ubuntu file. It does not regularly have .wcf-dist tacked on the end. That probably means the file was modified, and the distribution version was saved with a “disarmed” filename.
Your packages are up to date and your git files are up to date. The lack of the docker0 device is mildly alarming. If it were my box, I’d probably reboot and try the launcher again.
But that’s me with a long history of Unix, and not so long a history of using Discourse.
I just noticed there is another new topic, also with a docker0 problem:
Very likely the same problem, but it is not clear if that one is resolved.
That makes sense. Thank you.
Only mildly alarming? That’s somewhat encouraging, hopefully someone here knows how to resolve it.
This might help in identifying the issue, but as far as I’m aware it doesn’t seem to have any solutions.
In my case I didn’t even installed forum and this problem appears. [quote=“elijah, post:4, topic:57650”]
Very likely the same problem, but it is not clear if that one is resolved.
[/quote]
My problem right now isn’t resolved.
It appears again and again.
The lack of docker0 is very likely one of two things, in order of likelihood:
How would I do that? I’m afraid I’m in over my head with this issue.
That leads me to think Docker is not installed, or is not installed how Discourse expects it to be.
Does grep docker /var/log/*.log show errors or warnings?
Here’s what I get:
Would using wget -qO- https://get.docker.com/ | sh wipe the existing docker install or would it be safe to use? I found this topic as well and it was mentioned.
Sounds like true.
Here’s what I got after typing in terminal
wget -qO- https://get.docker.com/ | sh
from https://github.com/discourse/discourse/blob/master/docs/INSTALL-cloud.md
modprobe: ERROR: ../libkmod/libkmod.c:514 lookup_builtin_file() could not open b uiltin file '/lib/modules/2.6.32-042stab117.16/modules.builtin.bin'
modprobe: FATAL: Module aufs not found in directory /lib/modules/2.6.32-042stab1 17.16
Warning: current kernel is not supported by the linux-image-extra-virtual
package. We have no AUFS support. Consider installing the packages
linux-image-virtual kernel and linux-image-extra-virtual for AUFS support.
+ sleep 10
+ sh -c sleep 3; apt-get update
Get:1 http://archive.canonical.com/ubuntu xenial InRelease [11.5 kB]
Get:2 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB]
Get:3 http://archive.ubuntu.com/ubuntu xenial InRelease [247 kB]
Get:4 http://archive.canonical.com/ubuntu xenial/partner amd64 Packages [2664 B]
Get:5 http://archive.canonical.com/ubuntu xenial/partner Translation-en [1424 B]
Get:6 http://archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB]
Get:7 http://security.ubuntu.com/ubuntu xenial-security/main amd64 Packages [213 kB]
Get:8 http://security.ubuntu.com/ubuntu xenial-security/main Translation-en [89. 2 kB]
Get:9 http://security.ubuntu.com/ubuntu xenial-security/restricted amd64 Package s [6828 B]
Get:10 http://security.ubuntu.com/ubuntu xenial-security/restricted Translation- en [2272 B]
Get:11 http://security.ubuntu.com/ubuntu xenial-security/universe amd64 Packages [74.6 kB]
Get:12 http://security.ubuntu.com/ubuntu xenial-security/universe Translation-en [42.1 kB]
Get:13 http://security.ubuntu.com/ubuntu xenial-security/multiverse amd64 Packag es [2748 B]
Get:14 http://security.ubuntu.com/ubuntu xenial-security/multiverse Translation- en [1232 B]
Get:15 http://archive.ubuntu.com/ubuntu xenial/main amd64 Packages [1201 kB]
Get:16 http://archive.ubuntu.com/ubuntu xenial/main Translation-en [568 kB]
Get:17 http://archive.ubuntu.com/ubuntu xenial/restricted amd64 Packages [8344 B ]
Get:18 http://archive.ubuntu.com/ubuntu xenial/restricted Translation-en [2908 B ]
Get:19 http://archive.ubuntu.com/ubuntu xenial/universe amd64 Packages [7532 kB]
Get:20 http://archive.ubuntu.com/ubuntu xenial/universe Translation-en [4354 kB]
Get:21 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages [472 kB]
Get:22 http://archive.ubuntu.com/ubuntu xenial-updates/main Translation-en [186 kB]
Get:23 http://archive.ubuntu.com/ubuntu xenial-updates/restricted amd64 Packages [7176 B]
Get:24 http://archive.ubuntu.com/ubuntu xenial-updates/restricted Translation-en [2396 B]
Get:25 http://archive.ubuntu.com/ubuntu xenial-updates/universe amd64 Packages [ 397 kB]
Get:26 http://archive.ubuntu.com/ubuntu xenial-updates/universe Translation-en [ 149 kB]
Fetched 15.8 MB in 4s (3888 kB/s)
Reading package lists... Done
+ sh -c sleep 3; apt-get install -y -q apt-transport-https ca-certificates
Reading package lists...
Building dependency tree...
ca-certificates is already the newest version (20160104ubuntu1).
The following additional packages will be installed:
libcurl3-gnutls librtmp1
The following NEW packages will be installed:
apt-transport-https libcurl3-gnutls librtmp1
0 upgraded, 3 newly installed, 0 to remove and 72 not upgraded.
Need to get 264 kB of archives.
After this operation, 902 kB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu xenial/main amd64 librtmp1 amd64 2.4+2015 1223.gitfa8646d-1build1 [53.9 kB]
Get:2 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libcurl3-gnutls amd64 7.47.0-1ubuntu2.2 [184 kB]
Get:3 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 apt-transport-h ttps amd64 1.2.19 [26.0 kB]
Fetched 264 kB in 0s (1922 kB/s)
Selecting previously unselected package librtmp1:amd64.
(Reading database ... 26041 files and directories currently installed.)
Preparing to unpack .../librtmp1_2.4+20151223.gitfa8646d-1build1_amd64.deb ...
Unpacking librtmp1:amd64 (2.4+20151223.gitfa8646d-1build1) ...
Selecting previously unselected package libcurl3-gnutls:amd64.
Preparing to unpack .../libcurl3-gnutls_7.47.0-1ubuntu2.2_amd64.deb ...
Unpacking libcurl3-gnutls:amd64 (7.47.0-1ubuntu2.2) ...
Selecting previously unselected package apt-transport-https.
Preparing to unpack .../apt-transport-https_1.2.19_amd64.deb ...
Unpacking apt-transport-https (1.2.19) ...
Processing triggers for libc-bin (2.23-0ubuntu4) ...
Setting up librtmp1:amd64 (2.4+20151223.gitfa8646d-1build1) ...
Setting up libcurl3-gnutls:amd64 (7.47.0-1ubuntu2.2) ...
Setting up apt-transport-https (1.2.19) ...
Processing triggers for libc-bin (2.23-0ubuntu4) ...
+ sh -c sleep 3; apt-get install -y -q dirmngr
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
libassuan0 libksba8 libnpth0
The following NEW packages will be installed:
dirmngr libassuan0 libksba8 libnpth0
0 upgraded, 4 newly installed, 0 to remove and 72 not upgraded.
Need to get 368 kB of archives.
After this operation, 1041 kB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu xenial/main amd64 libassuan0 amd64 2.4.2- 2 [34.6 kB]
Get:2 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libksba8 amd64 1.3.3-1ubuntu0.16.04.1 [90.2 kB]
Get:3 http://archive.ubuntu.com/ubuntu xenial/main amd64 libnpth0 amd64 1.2-3 [7 998 B]
Get:4 http://archive.ubuntu.com/ubuntu xenial/main amd64 dirmngr amd64 2.1.11-6u buntu2 [235 kB]
Fetched 368 kB in 0s (2050 kB/s)
Selecting previously unselected package libassuan0:amd64.
(Reading database ... 26059 files and directories currently installed.)
Preparing to unpack .../libassuan0_2.4.2-2_amd64.deb ...
Unpacking libassuan0:amd64 (2.4.2-2) ...
Selecting previously unselected package libksba8:amd64.
Preparing to unpack .../libksba8_1.3.3-1ubuntu0.16.04.1_amd64.deb ...
Unpacking libksba8:amd64 (1.3.3-1ubuntu0.16.04.1) ...
Selecting previously unselected package libnpth0:amd64.
Preparing to unpack .../libnpth0_1.2-3_amd64.deb ...
Unpacking libnpth0:amd64 (1.2-3) ...
Selecting previously unselected package dirmngr.
Preparing to unpack .../dirmngr_2.1.11-6ubuntu2_amd64.deb ...
Unpacking dirmngr (2.1.11-6ubuntu2) ...
Processing triggers for libc-bin (2.23-0ubuntu4) ...
Processing triggers for man-db (2.7.5-1) ...
Setting up libassuan0:amd64 (2.4.2-2) ...
Setting up libksba8:amd64 (1.3.3-1ubuntu0.16.04.1) ...
Setting up libnpth0:amd64 (1.2-3) ...
Setting up dirmngr (2.1.11-6ubuntu2) ...
Processing triggers for libc-bin (2.23-0ubuntu4) ...
+ sh -c apt-key adv --keyserver hkp://ha.pool.sks-keyservers.net:80 --recv-keys 58118E89F3A912897C070ADBF76221572C52609D
Executing: /tmp/tmp.H5xJU9gvQm/gpg.1.sh --keyserver
hkp://ha.pool.sks-keyservers.net:80
--recv-keys
58118E89F3A912897C070ADBF76221572C52609D
gpg: requesting key 2C52609D from hkp server ha.pool.sks-keyservers.net
gpg: key 2C52609D: public key "Docker Release Tool (releasedocker) <docker@docke r.com>" imported
gpg: Total number processed: 1
gpg: imported: 1 (RSA: 1)
+ break
+ sh -c apt-key adv -k 58118E89F3A912897C070ADBF76221572C52609D >/dev/null
+ sh -c mkdir -p /etc/apt/sources.list.d
+ dpkg --print-architecture
+ sh -c echo deb \[arch=amd64\] https://apt.dockerproject.org/repo ubuntu-xenial main > /etc/apt/sources.list.d/docker.list
+ sh -c sleep 3; apt-get update; apt-get install -y -q docker-engine
Hit:1 http://archive.canonical.com/ubuntu xenial InRelease
Hit:2 http://security.ubuntu.com/ubuntu xenial-security InRelease
Hit:3 http://archive.ubuntu.com/ubuntu xenial InRelease
Hit:4 http://archive.ubuntu.com/ubuntu xenial-updates InRelease
Get:5 https://apt.dockerproject.org/repo ubuntu-xenial InRelease [30.2 kB]
Get:6 https://apt.dockerproject.org/repo ubuntu-xenial/main amd64 Packages [3580 B]
Fetched 33.8 kB in 0s (62.2 kB/s)
Reading package lists... Done
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
apparmor aufs-tools cgroupfs-mount git git-man libapparmor-perl
liberror-perl
Suggested packages:
apparmor-profiles apparmor-profiles-extra apparmor-docs apparmor-utils
git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk
gitweb git-arch git-cvs git-mediawiki git-svn
The following NEW packages will be installed:
apparmor aufs-tools cgroupfs-mount docker-engine git git-man
libapparmor-perl liberror-perl
0 upgraded, 8 newly installed, 0 to remove and 72 not upgraded.
Need to get 23.6 MB of archives.
After this operation, 117 MB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libapparmor-per l amd64 2.10.95-0ubuntu2.5 [31.4 kB]
Get:2 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 apparmor amd64 2.10.95-0ubuntu2.5 [446 kB]
Get:3 https://apt.dockerproject.org/repo ubuntu-xenial/main amd64 docker-engine amd64 1.13.1-0~ubuntu-xenial [19.3 MB]
Get:4 http://archive.ubuntu.com/ubuntu xenial/universe amd64 aufs-tools amd64 1: 3.2+20130722-1.1ubuntu1 [92.9 kB]
Get:5 http://archive.ubuntu.com/ubuntu xenial/universe amd64 cgroupfs-mount all 1.2 [4970 B]
Get:6 http://archive.ubuntu.com/ubuntu xenial/main amd64 liberror-perl all 0.17- 1.2 [19.6 kB]
Get:7 http://archive.ubuntu.com/ubuntu xenial/main amd64 git-man all 1:2.7.4-0ub untu1 [735 kB]
Get:8 http://archive.ubuntu.com/ubuntu xenial/main amd64 git amd64 1:2.7.4-0ubun tu1 [3006 kB]
Fetched 23.6 MB in 2s (10.5 MB/s)
Preconfiguring packages ...
Selecting previously unselected package libapparmor-perl.
(Reading database ... 26094 files and directories currently installed.)
Preparing to unpack .../libapparmor-perl_2.10.95-0ubuntu2.5_amd64.deb ...
Unpacking libapparmor-perl (2.10.95-0ubuntu2.5) ...
Selecting previously unselected package apparmor.
Preparing to unpack .../apparmor_2.10.95-0ubuntu2.5_amd64.deb ...
Unpacking apparmor (2.10.95-0ubuntu2.5) ...
Selecting previously unselected package aufs-tools.
Preparing to unpack .../aufs-tools_1%3a3.2+20130722-1.1ubuntu1_amd64.deb ...
Unpacking aufs-tools (1:3.2+20130722-1.1ubuntu1) ...
Selecting previously unselected package cgroupfs-mount.
Preparing to unpack .../cgroupfs-mount_1.2_all.deb ...
Unpacking cgroupfs-mount (1.2) ...
Selecting previously unselected package docker-engine.
Preparing to unpack .../docker-engine_1.13.1-0~ubuntu-xenial_amd64.deb ...
Unpacking docker-engine (1.13.1-0~ubuntu-xenial) ...
Selecting previously unselected package liberror-perl.
Preparing to unpack .../liberror-perl_0.17-1.2_all.deb ...
Unpacking liberror-perl (0.17-1.2) ...
Selecting previously unselected package git-man.
Preparing to unpack .../git-man_1%3a2.7.4-0ubuntu1_all.deb ...
Unpacking git-man (1:2.7.4-0ubuntu1) ...
Selecting previously unselected package git.
Preparing to unpack .../git_1%3a2.7.4-0ubuntu1_amd64.deb ...
Unpacking git (1:2.7.4-0ubuntu1) ...
Processing triggers for systemd (229-4ubuntu12) ...
Processing triggers for man-db (2.7.5-1) ...
Processing triggers for libc-bin (2.23-0ubuntu4) ...
Setting up libapparmor-perl (2.10.95-0ubuntu2.5) ...
Setting up apparmor (2.10.95-0ubuntu2.5) ...
update-rc.d: warning: start and stop actions are no longer supported; falling ba ck to defaults
diff: /var/lib/apparmor/profiles/.apparmor.md5sums: No such file or directory
Setting up aufs-tools (1:3.2+20130722-1.1ubuntu1) ...
Setting up cgroupfs-mount (1.2) ...
Setting up docker-engine (1.13.1-0~ubuntu-xenial) ...
Job for docker.service failed because the control process exited with error code . See "systemctl status docker.service" and "journalctl -xe" for details.
invoke-rc.d: initscript docker, action "start" failed.
dpkg: error processing package docker-engine (--configure):
subprocess installed post-installation script returned error exit status 1
Setting up liberror-perl (0.17-1.2) ...
Setting up git-man (1:2.7.4-0ubuntu1) ...
Setting up git (1:2.7.4-0ubuntu1) ...
Processing triggers for systemd (229-4ubuntu12) ...
Processing triggers for libc-bin (2.23-0ubuntu4) ...
Errors were encountered while processing:
docker-engine
E: Sub-process /usr/bin/dpkg returned an error code (1)
However, after this action server respond to cmd docker bot, when I try to run ./discourse-setup, after configurate app.yml it returns Device docker0 does not exist
@elijah It’s worth pointing out before I encountered this issue I upgraded the Ubuntu version and ran ./launcher reboot app
Well, did you install those?
apt-get install linux-image-virtual linux-image-extra-virtual
That probably requires a reboot after the install.
Discourse relies on the AUFS filesystem.
@zcalbrecht That’s a lot of stuff. The interesting bits probably scrolled off. Try it with head, eg:
grep docker /var/log*.log | head -20
Reading package lists... Done
Building dependency tree
Reading state information... Done
linux-image-extra-virtual is already the newest version (4.4.0.62.65).
linux-image-virtual is already the newest version (4.4.0.62.65).
The following packages were automatically installed and are no longer required:
aufs-tools cgroupfs-mount git git-man liberror-perl
Use 'apt autoremove' to remove them.
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
5 not fully installed or removed.
After this operation, 0 B of additional disk space will be used.
Do you want to continue? [Y/n] y
Setting up linux-image-4.4.0-62-generic (4.4.0-62.83) ...
Running depmod.
update-initramfs: deferring update (hook will be called later)
The link /initrd.img is a dangling linkto /boot/initrd.img-4.4.0-62-generic
vmlinuz(/boot/vmlinuz-4.4.0-62-generic
) points to /boot/vmlinuz-4.4.0-62-generic
(/boot/vmlinuz-4.4.0-62-generic) -- doing nothing at /var/lib/dpkg/info/linux-image-4.4.0-62-generic.postinst line 491.
Examining /etc/kernel/postinst.d.
run-parts: executing /etc/kernel/postinst.d/apt-auto-removal 4.4.0-62-generic /boot/vmlinuz-4.4.0-62-generic
run-parts: executing /etc/kernel/postinst.d/initramfs-tools 4.4.0-62-generic /boot/vmlinuz-4.4.0-62-generic
update-initramfs: Generating /boot/initrd.img-4.4.0-62-generic
E: /usr/share/initramfs-tools/hooks/fixrtc failed with return 1.
update-initramfs: failed for /boot/initrd.img-4.4.0-62-generic with 1.
run-parts: /etc/kernel/postinst.d/initramfs-tools exited with return code 1
Failed to process /etc/kernel/postinst.d at /var/lib/dpkg/info/linux-image-4.4.0-62-generic.postinst line 1052.
dpkg: error processing package linux-image-4.4.0-62-generic (--configure):
subprocess installed post-installation script returned error exit status 2
dpkg: dependency problems prevent configuration of linux-image-extra-4.4.0-62-generic:
linux-image-extra-4.4.0-62-generic depends on linux-image-4.4.0-62-generic; however:
Package linux-image-4.4.0-62-generic is not configured yet.
dpkg: error processing package linux-image-extra-4.4.0-62-generic (--configure):
dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of linux-image-generic:
linux-image-generic depends on linux-image-4.4.0-62-generic; however:
Package linux-image-4.4.0-62-generic is not configured yet.
linux-image-generic depends on linux-image-extra-4.4.0-62-generic; however:
Package linux-image-extra-4.4.0-62-generic is not configured yet.
dpkg: error processing package linux-image-generic (--configure):
dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of linux-image-extra-virtual:
linux-image-extra-virtual depends on linux-image-generic (= 4.4.0.62.65); however:
Package linux-image-generic is not configured yet.
dpkg: error processing package linux-image-extra-virtual (--configure):
dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of linux-image-virtual:
linux-image-virtual depends on linux-image-4.4.0-62-generic; however:
Package linux-image-4.4.0-62-generic is not configured yet.
dpkg: error processing package linux-image-virtual (--configure):
dependency problems - leaving unconfigured
Errors were encountered while processing:
linux-image-4.4.0-62-generic
linux-image-extra-4.4.0-62-generic
linux-image-generic
linux-image-extra-virtual
linux-image-virtual
E: Sub-process /usr/bin/dpkg returned an error code (1)
There’s a bundle of errors. =.="
Well, errors disappear when I change VPS from current to DigitalOcean. Only thing I got from all this stuff… ProHoster.info can be add to blacklist for Discourse
The log has rotated out. Previous errors ended in the 4000ish seconds since reboot, this is in the 130,700ish seconds. I don’t know enough about Docker / Apparmor interactions to know if that is a harmless set of messages or not.
At this point it would be interesting to know what happened to bring the forum down, as mentioned in first post. Did it just spontaneously stop? Are there interesting events in /var/log/syslog (or syslog.1 or syslog.2.gz…) at the time the forum went down? I’m suspecting some piece of software got upgraded and that broke things. This is supported by the first screenshot showing that there was zero packages to install.
I’m hoping someone with more familiarity with Discourse on Ubuntu 16 can chime in. I’m still on 14.04 for my single instance.
I found a fix to my problem. Apparently just starting the docker works with this command: # service docker restart
Thank you so much @elijah for helping me find the issue.
