I’m trying to move uploads to s3 on a relatively busy site. Everything goes as planned except when I run rake uploads:migrate_to_s3, I am presented with the following error: Updating the URLs in the database... Removing old optimized images... Flagging all posts containing lightboxes for rebake...…

Looking at the error message from your previous post, it’s the count on line 85 which is of interest. @Falco ’s suggestion for editing the script is to increase that count to ignore some number of failures. The simplest way to achieve that is by entering the container and using sed to make an in-pla…

Something else you could try after having removed the file and completed the migration (and having downloaded the failing file) is to edit the post again to put the file back in. It’d be interesting to know if it fails to upload to S3 entirely or only during the migration task.

I got the same error, on 64 post. Impossible to find them on 80K files… What would happen if I delete local files (most of them are alredy migrated)?

I confirm that files are migrated, but I got the same error.

Any suggestions? Uploads are on s3 and work fine, but the task: migrate to s3 fails.

[תמונה] Saiano: I got the same error, on 64 post. Impossible to find them on 80K files If you are okay with losing those 64 files, what I did when this same rake task kept failing on me is to edit it, and make it error inly if there are 100 errors instead of 1.

[תמונה] Falco: f you are okay with losing those 64 files, what I did when this same rake task kept failing on me is to edit it, and make it error inly if there are 100 errors instead of 1. It would be fine for me. What Shoud I do to edit the task?

You can first try to run it with: SKIP_FAILED=1 rake uploads:migrate_to_s3. If that doesn’t work edit this line here and try again lib/file_store/to_s3_migration.rb main base_url = File.join(SiteSetting.Upload.s3_base_url, prefix) count = …

Tried with SKIP_FAILED=100 rake uploads:migrate_to_s3 => 0 files Listing S3 files … … => 81070 files Syncing files to S3 Updating the URLs …

[תמונה] Saiano: Tried with SKIP_FAILED=100 rake uploads:migrate_to_s3 I may have misunderstood, but I think you need to run SKIP_FAILED=1 to turn the SKIP_FAILED on, rather than assign an amount.

[תמונה] Saiano: SKIP_FAILED=1 rake uploads:migrate_to_s3 Tried with this command. … same Result

Migrate_to_s3 נכשל

תמיכה התקנה

vulkanino (Marco) 21 בפברואר,‏ 2022,‏ 3:19pm 23

Yes, you may have already seen the discussion here:

נושא		תגובות	צפיות
1 of 16551 uploads are not migrated to S3. S3 migration failed for db 'default' Self-hosting s3 , cdn	22	1787	10 באוגוסט,‏ 2023
Uploads migration to S3 fails Support	26	3184	7 במאי,‏ 2021
Migrating old uploads to S3 Self-hosting s3	8	1619	11 במאי,‏ 2021
Rake uploads:migrate_from_s3 fails Self-hosting s3	31	3055	24 באפריל,‏ 2021
Rake migrate_to_s3 errors Self-hosting s3	3	742	4 בפברואר,‏ 2020

Migrate_to_s3 נכשל

נושאים קשורים