I want to migrate my files from s3 back to local. I’m manually transferring all files from s3 to uploads folder. Then should be changing the base url of upload links, back to forum base url, sufficient to do the job done?

[image] pfaffman: There is a hidden site setting called something like “download S3 uploads to local on backup”. I did commanded that setting in Rails console SiteSetting.include_s3_uploads_in_backups = true. But it still didn’t (seem to) have any effect. The backup still was the same size (approx 375 MB, even when my uploads are around 700 MB to 1GB). [image] pfaffman: shadowed site settings in environment variables If by ‘Shadowed site settings’ you mean all the S3 site settings in Disco Web UI, then I do have all those settings filled in those fields.

I’m also looking to migrate my uploads from S3 to local (separate VPS). Is there a documented procedure for this?

Not really. I’d try using the setting I described above

Is there a way to find these hidden settings?

The one that you might need in context of this discussion is mentioned above. You can see them all in site_settings.yml in the Discourse source.

You can turn on the hidden site setting that’s called something like download_s3_with_backups (that’s not quite right but I can’t find it on my phone right now) and then restore that backup. That’s what happens when you leave cdck hosting, and it works. You might need to restore to a different server (and u would anyway to test). Edit: thanks @Benjamin_D! it’s include_s3_uploads_in_backups

I think this is it: config/site_settings.yml f25e77922 include_s3_uploads_in_backups: default: false hidden: true

Isn’t that option is available on the Settings page in the Admin website controls Backup Settings page? Also isn’t this the opposite of downloading the S3 files? [image]

[image] RBoy: Isn’t that option is available on the Settings page in the Admin website controls Backup Settings page? No. backup_with_uploads is not the same as include_s3_uploads_in_backups. One includes local files in the backup. The other downloads every single file from s3 every time you make a backup. And the whole point of s3 is that you don’t need to make backups of it.

Migrating uploads from S3 to local

Product Support Self-hosting

RBoy (RBoy) August 9, 2022, 2:44pm 14

This rake task is no longer available in 2.9.0 BETA 8

Anyone have an ideas how to migrate from S3 to local?

Topic		Replies	Views
How to manually migrate s3 files to local? Product Support	2	286	February 25, 2025
Intended path to migrate S3 to local Self-hosting uploads , s3	5	990	May 13, 2023
Migrate_from_s3: You must disable S3 uploads before running that task Product Support	21	1611	September 19, 2020
Rake uploads:migrate_from_s3 fails Self-hosting s3	31	3621	April 24, 2021
Can Discourse migrate what is already in in locally when it is connected to S3 storage? Self-hosting uploads , s3	3	259	August 15, 2024

Migrating uploads from S3 to local

Related topics