I’m running a very visual oriented community (www.realtimevfx.com) and have watched my disk space creep up over the past year (obviously). I’m about to do some cleanup (per this discussion “https://meta.discourse.org/t/low-on-disk-space-cleaning-up-old-docker-containers/15792/83”), but I wanted to start a general conversation to get people’s thoughts on the best way to approach this - If I can avoid it, I’d rather not have exponential disk space growth as the community grows. Are there best practices / standards that I should implement regarding user uploads? Should I disable uploads entirely and have people only host through imgur, etc?

Serve static resources via AWS is the best You can do as it will offload a significant amount of less important data from the server.

[imagem] itsbhanusharma: Serve static resources via AWS is the best Won’t the local copies of all uploaded images still reside on your server?

Rebuild Your container once the Images are offloaded to s3 bucket and then all those can be safely removed from your local server. system is supposed to automatically clean up the content once it is properly uploaded to the AWS cloud.

[imagem] itsbhanusharma: system is supposed to automatically clean up the content once it is properly uploaded to the AWS cloud. I see, didn’t know about it. What about making a backup of a Discourse instance, it won’t contain those images, will it?

it will contain necessary references to those images and when You restore such a backup, it will link them to Your instance’s AWS s3 configuration and look for resources in the relative directories afaik but maybe someone from the discourse team can provide better details about how backups are handled in case of files. @HAWK @sam can You provide some extra details about how backups handle the media files uploaded by users?

When images are stored on S3, they won’t be backed up by Discourse anymore. This would be pointless since most of the time, you’re using S3 because you don’t have enough space locally. If you want to backup your images, I’m sure there are plenty of tools available to do that by talking to S3 directly :wink:

@zogstrip one Question though! what if that backup is restored when the site is moved to a new host? will that break all the images or will it be as simple as configuring with the same AWS details again to restore all the media?

Backup will contain all your site settings. So new restored instance also will have the same S3 configuration.

I have several question about images storage/processing I have two folders /var/discourse/shared/standalone/uploads/default/original — 9GB in my case ../3X ../2X ../1X /var/discourse/shared/standalone/uploads/default/optimized — 4GB in my case ../3X ../2X ../1X Is there way to keep only optimized images? Does folder /var/discourse/shared/standalone/postgres_data/base store the same images as folders above? Is there any Discourse settings for storing images in lower quality? Is there any client-side image optimization to make it lower size?

[imagem] Dmitry_Krasnoperov: Is there way to keep only optimized images? Original images are shown when their optimised counterparts within topics/replies are clicked.

Best Practices for Disk Space Management in Community w/ lots of Images

Product Support Self-hosting

meglio (Anton) 27 Novembro , 2017 05:33 3

Won’t the local copies of all uploaded images still reside on your server?

Tópico		Respostas	Vistas
Would it be worth resizing uploaded images (to save space)? Feature	26	5329	11 Outubro , 2019
Disk usage spike during backup, Discourse crashed hard :-( Self-hosting server-resources	21	3075	23 Julho , 2020
Configure automatic backups for Discourse Self-Hosting backups , how-to	44	305141	19 Maio , 2026
Where are Images and uploads stored? Product Support uploads	8	532	22 Julho , 2024
Move discourse uploads to free space on server Product Support	6	1184	16 Fevereiro , 2022

Best Practices for Disk Space Management in Community w/ lots of Images

Related topics