Hi, we’ve set up upload hosting (using the S3 settings) on Backblaze. New uploads are working (after the x-amz-checksum-crc32 header fix), however trying to migrate existing uploads with uploads:migrate_to_s3 fails immediately. This is on the latest Discourse version (3.5.0.beta5-dev). Here is th…

[image] stanski: using the S3 settings You need to put them in your app.yml as described at Configure an S3 compatible object storage provider for uploads [image] stanski: after the x-amz-checksum-crc32 header fix Do you mean that you added code to your app.yml to revert the aws libra…

[image] pfaffman: You need to put them in your app.yml as described at Configure an S3 compatible object storage provider for uploads Yes, they are in app.yml and I’ve rebuilt the app. I’ve confirmed that newly uploaded files are going there. [image] pfaffman: Do you mean that you added…

[image] stanski: Some uploads were not migrated to the new scheme. Running the migration, this may take a while... rake aborted! You’ll likely need to track those down yourself. In rails you can Upload.pluck(:url) And then look for which uploads are the problem. [image] stanski: I’m …

Manually downgrading the aws gems in the container did get the uploads:migrate_to_s3 job to actually upload images so apparently the env variables wasn’t enough, as you pointed out. However the process failed later at a different point: FileStore::ToS3MigrationError: 2 posts are not remapped to ne…

That may be because you have one boxes referring to local posts. I made a topic about it but can’t quite remember the details. If it’s just 2,you might just ignore it, but in rails you can find all the uploads that don’t have your new bucket in them. I think it’ll be empty? I think the issue is th…

[image] pfaffman: Can’t restore a backup if it includes link to Discourse onebox Edit: so I think you’ve got two posts with local one boxes. I think you just need to find and rebake those posts. @stanski did this solve your problem?

Sorry, got caught up and forgot to update this. After rebaking all posts, I got a different error message when trying the migration again. I can’t find the backtrace anymore unfortunately. I realized that despite of the error, it appeared that uploads were migrated to Backblaze and the posts upda…

[image] stanski: Now I have a complaint that various firewalls are blocking backblaze-hosted uploads, but that’s another matter You really want to use a cdn, I think.

Can't migrate uploads to S3

Product Support

pfaffman (Jay Pfaffman) June 12, 2025, 11:28pm 10

You really want to use a cdn, I think.

Topic		Replies	Views
Migrating old uploads to S3 Self-hosting s3	8	1754	May 11, 2021
Unable to migrate to S3, therefore unable to restore from backup Self-hosting	2	1351	March 9, 2022
Uploads migration to S3 fails Product Support	26	3587	May 7, 2021
Restore process cancelled at migrating uploads to S3 step Product Support	48	3894	January 24, 2026
Migrating Site to S3 Self-hosting s3	2	813	May 25, 2020

Can't migrate uploads to S3

Related topics