While my new uploads are uploading very correctly on Amazon S3, this command is failing to shift the old one from local to S3: DISCOURSE_S3_BUCKET="bucketname" DISCOURSE_S3_REGION="ap-south-1" DISCOURSE_S3_ACCESS_KEY_ID="AKIchangedabitUNM2" DISCOURSE_S3_SECRET_ACCESS_KEY="rX6Pf3C_changedabit_YKKtdV…

[image] Bathinda: this command is failing to shift the old one from local to S3. While 15 days ago, this command worked like a charm. Is it returning any errors? I’m unable to see any recent big changes in the code of the uploads:migrate_to_s3 rake task.

I had a similar problem. It had to do with the path of the uploads not matching what that test expects (like it’s missing ‘default’ in the path of something). What I did was (in broad and likely unhelpful terms) to see what search is doing to find those uploads that it thinks are bad and fix them

I happen to solve it accidentally and in a way that I’m still not sure how it got solved. I changed the command a couple of times mostly appending or removing the word ‘dualstack’ in the command and in CDN url field in Discourse Settings: https://bxyzbucket1.s3.dualstack.ap-south-1.amazonaws.com B…

Whatever error was coming/showing, I already included in my original post. But I agree that that error/msg wasn’t very helpful in diagnosis. Alas, today again, I thought since I couldn’t understand the problem in migration, I created 1 upload locally. Then tried to shift that again to S3 with this …

Can you please run the following command in rails console and post the output here Upload.by_users.where("url NOT LIKE '//%' AND url NOT LIKE '#{GlobalSetting.relative_url_root}/uploads/default/original/_X/%'")

[image] vinothkannans: Upload.by_users.where("url NOT LIKE '//%' AND url NOT LIKE '#{GlobalSetting.relative_url_root}/uploads/default/original/_X/%'") Sorry that I was away from this operation for some time. I’m running the rails command sent by you, but no output is coming: [image] I sti…

@vinothkannans Even after a year, when I happen to repeat the process for some reason, still same error is coming.

Migrating old uploads to S3

Support Self-hosting

codinghorror (Jeff Atwood) November 22, 2019, 4:59pm 2

Any idea here @vinothkannans?

Rake migrate_to_s3 errors

Topic		Replies	Views
Uploads migration to S3 fails Support	26	3312	May 7, 2021
Rake migrate_to_s3 errors Self-hosting s3	3	779	February 4, 2020
Migrating Site to S3 Self-hosting s3	2	771	May 25, 2020
Migrate_to_s3 fails Self-hosting s3	25	2118	February 21, 2022
Migrating uploads to S3 fails Self-hosting s3	1	762	October 25, 2024

Migrating old uploads to S3

Related topics