Hi! Had a search in Support but couldn’t find an existing answer, so forgive me for a quick support question: We’ve been using S3 to store Discourse files since about 2016. When I look at the root of the S3 bucket I was surprised to see the directory structure ‘above’ the ones I expected to be the…

Good question, who would know the history of this @sam ?

I think we might also be a bit weird :slight_smile: in that we’ve been running Discourse since about 2015, and have changed storage locations over the years. We started out using local storage for files, got some growth and then moved over to using S3 stored uploads. At that time I don’t think we m…

Honestly I don’t know how these 96->99 folders came about, they are not where we store uploads.

Thanks for looking @sam , good to know - I wonder if we manually copied up to S3 what we had, and it went wrong. It hasn’t caused any harm. We have at S3 bucket root _emoji/ _optimized/ optimized/ original/ tombstone/ Plus a whole bunch of numbered directories going from 1/ to 225/. Each numbered …

Those files are always there on very old forums (around 2014). I think they predate optimized and original and I suspect they are still being referred to.

I couldn’t resist finding this out. This is indeed an old upload scheme. It was abandoned later than I suspected, in May 2015, with this commit. https://github.com/discourse/discourse/commit/9ded21e4c61d4c1e71f57a778d519ddea26c96e2 These uploads are indeed still being used, so do not remove them!

Thanks Michael. As these are when we first got going in 2014 then the file numbers are small and we’ll keep them where they are. :slight_smile: Interesting enough, we did move server recently, and went for a Discourse backup / restore route (rather than upgrade in place of the base Unix version) an…

Quick AWS S3 Files Storage Question - Structure?

Product Support

sam (Sam Saffron) November 4, 2020, 3:12am 6

Yes, that sounds about right.

Topic		Replies	Views
Broken Images and Their S3 URLs Product Support	32	5265	August 31, 2020
Can Discourse migrate what is already in in locally when it is connected to S3 storage? Self-hosting uploads , s3	3	238	August 15, 2024
Set up file and image uploads to S3 Self-Hosting configuring , how-to	35	121974	October 25, 2025
Does anyone have some suggestions how should I go about investigating Discourse losing old uploads? Product Support	0	55	July 4, 2024
S3 upload: Bypass Discourse local storage Product Support	4	1264	November 30, 2021

Quick AWS S3 Files Storage Question - Structure?

Related topics