Our free disk space went down by about a gig overnight, or rather the backup image size jumped up. We’re trying to figure out where it went, as we think a user may be uploading files to themselves via PM or something? Where are good places to start looking in Discourse for this type of info, i.e. …

So @sam just to be super brief :slight_smile: perhaps the simplest thing that would work for us is that I just do a ./launcher enter app rails c ..and then just use models for Upload (:filesize) and User and go irb query that way? I think that would get what we want. EDIT: Yep, I just did it tha…

try this commands in your host: sudo apt-get autoclean sudo apt-get autoremove cd /var/discourse and after sudo ./launcher cleanup and press y for cleanup files!

Usually what I’ll do is to run df -h and see which file system is taking up most of the disk space and then try to narrow down the scope with du -h with an optional --max-depth=1 to find the offending file/folder. Another tool that you might want to checkout is ncdu

Thank you - yep, we do that and it certainly does stop the bumps. I’ll double check for sure, but also did want to just see if there was a quota/report per user as well - especially as it was within the Discourse backup.tar.gz.

[image] fearlessfrog: 9GB of uploaded content 9GB Whew! Are your settings very high? max image size kb The maximum image upload size in kB. This must be configured in nginx (client_max_body_size) / apache or proxy as well. max attachment size kb The maximum attachment files upload size …

[image] Mittineague: Or is this a member doing a mess of smaller uploads? ^ That. Our max image size was left at 3072 kb. It looks like just over a year of constant screen-shot uploading, but we are still figuring that out. It doesn’t look malicious, just really keen/dedicated and we are a ve…

Ok, some new information the more we dig. This looks like a Discourse bug somehow. The user with the 9 GB of files has the same 13 files that were uploaded as a set repeated 1728 times, i.e. 22,464 duplicate file uploads. I’ll raise a bug and hopefully we can remove these plus stop it happening ag…

[image] fearlessfrog: the same 13 files that were uploaded as a set repeated 1728 times Hmmm, AFAIK the only multiple images are optimized_images of uploaded avatars [image] I think there is something different going on here with your situation. I cant imagine avatars weighing all that mu…

Unless he enabled animated avatars.

I recognize the filenames repeated I think, and am pretty sure this was a bulk upload of screenshots either in a topic post or in a personal message. The size of the files (all .png’s) is like ‘595934 bytes’ or ‘322155’ as in, not files that look like they have been processed to thumbs or are avatar…

on my site it turned out to be backups that take up all the space. I’ve now changed it to only keep 3 on server, and the rest on s3. I also turned off “s3 disable cleanup” which means I can decide myself which backups there to keep.

Our disk space disappeared - how to find who/where?

Product Support Self-hosting

jord8on (Jordan) March 8, 2020, 3:02am 13

@tobiaseigen, Thank you for chiming back in with what you did here. This is super helpful insight!!

Topic		Replies	Views
User Upload Reporting & Quota Feature	6	2169	June 20, 2016
Discourse disk space limits per user? Feature	9	2731	February 10, 2024
Duplicate Uploaded Files Bug	3	1515	June 20, 2016
List of all uploaded files Feature planned	15	4970	February 20, 2023
Large image uploads by users Product Support	2	560	April 13, 2020

Our disk space disappeared - how to find who/where?

Related topics