Hello. I’m looking for advice on how best to setup a reliable backup system for one of Discourse forums I administrate. The backup file that gets generated is around 3GB. (This forum was populated by importing 20 years worth of a mailing list emails with images, thus the size.) We use Communiteq (f…

We keep 2 backups and use S3. Our backups include uploads and they are at 8GB now. The RO time during the backups has stayed roughly the same (actually since out last CPU and RAM injection it’s gone down). Keeping much more than 2-7 backups probably isn’t going to help you much. If you get a massiv…

This is great to hear given the size of your backups. I think I will forge on with S3 and try to get it working. Thanks for weighing in!

[image] Sander78: Would it be possible for Discourse to create delta backups in the near future? I’d consider it extremely unlikely. Taking a diff of a relational database is far from trivial, and the gains are minimal. If you’re running a large enough site to make app-level “delta backups”…

Full DB and delta of uploads should both be doable and much smaller for a site like this. That’s not something available now. Even just full DB and no uploads might be useful for a case like this. And that’s a currently supported backup option. [image]

Just skipping uploads is probably sufficient. The images are usually much much larger than the DB.

Recommended backup process for very large forum?

Support

Sander78 (Sander Datema) July 11, 2017, 3:22pm 4

Would it be possible for Discourse to create delta backups in the near future? That would save a lot of space for larger forums.

Topic		Replies	Views
How big is your Discourse backup? Support	15	3926	April 25, 2016
Multiple backup schedules Feature	14	1333	April 13, 2022
Is there any reason why daily backups would see a reduction in size? Support	25	1720	July 23, 2019
Can I backup multiple times a day, and are they safe if the server goes down Self-hosting backups	16	672	March 13, 2024
Better auto-backup options Feature backups , s3	3	2134	August 3, 2017

Recommended backup process for very large forum?

Related topics