Discourse not respecting the number of S3 backups to keep

Similar issue has re-occurred for us. Just noticed I have dozens of local backups (1.6GB each), while the setting is restricted to value 3. This has worked for years, but I do recall one incident a long time ago when a similar issue happened.

  • Backups complete successfully
  • Uploads to S3 are successful
  • Running the stable branch. Just upgraded to 2.3.7 and rebooted.

Need to dig in deeper at a better time.

Ping @rizka

Update:

The issue has started on 11th of September. That date does not match to our service breaks or anything we would have done for the site.

Update:

This is not an isolated case, as my other small sandbox instance has the same issue, it seems. This is in completely different infrastructure, hosted at Digital Ocean. Here the backups have not been deleted since September 16th. Uploads are successful here as well.

「いいね!」 1

Okay…now this is starting to look like a stupid user error – I have completely missed the change in how the backup management is currently working. So Discourse now manages and deletes S3 backups directly, without the need to purge the old backups with a bucket rule? Now increasing the value to 30, as backups should not eat up local disk space.

The number of backups that were stored in the S3 buckets did not match the setting 3 though.

I have no issue with AWS S3 backups on my self hosted instance:

「いいね!」 1

I have now reconfigured backups and bucket rules to sane values, matching the current Discourse behavior. Like said, I had the number of backups set to 3, based on the old logic of backups. Now it is set at 30.

Please keep the thread open, and I’ll report back in 30 days to verify that Discourse now respects the re-defined new value.

Forgot about this issue, but now had a look. I have 97 backups stored in S3 while the setting is at 30.

Still running the 2.3 branch, preparing to update to 2.4 soon.

「いいね!」 1

結局、この件は解決しましたか?

「いいね!」 1

ああ、これは昔の話ですね。何らかの形で解決されたような気がしますが、私たちはもう何年もCDCK SaaSを利用しており、この問題についてはもうはっきりと思い出せません。

もしこれがまだ問題だったとしたら、他のセルフホスティング者が報告したのではないでしょうか?

「いいね!」 1

まったく同じ問題を抱えていました。そして、過去10分間で、s3_disable_cleanup をオンにしてしまっていたことが原因だとわかりました。s3アップロードのみに関連し、バックアップには関係ないと思っていました。しかし、それは間違いでした。

「いいね!」 1