Hi there, I’m trying to migrate to S3, but my migrate_to_s3 fails. Updating the URLs in the database... Removing old optimized images... Flagging all posts containing lightboxes for rebake... 9756 posts were flagged for a rebake 1 of 16545 uploads are not migrated to S3. S3 migration failed for db…

Ok, so this issue has been now fixed! Here’s how I did it (with immense help of Artur from our forum) In to_s3_migration.rb , I’ve changed this: count = Upload.by_users.where("url NOT LIKE '#{base_url}%'").count if count > 0 error_message = "#{count} of #{Upload.count} uploa…

So after all of this, turned off and on again and unfortunately: Updating the URLs in the database... Removing old optimized images... Flagging all posts containing lightboxes for rebake... 5493 posts were flagged for a rebake 1 of 16551 uploads are not migrated to S3. S3 migration failed for db 'd…

[이미지] Paweł Orzech: See full trace by running task with --trace) Did you try running it again, with the above command?

Yep, let me do it once again. I’m gonna paste here updated log after it does the thing. Updating the URLs in the database... Removing old optimized images... Flagging all posts containing lightboxes for rebake... 5672 posts were flagged for a rebake rake aborted! FileStore::ToS3MigrationError: 1 of…

Unless that 1 upload is absolutely critical, here is your solution: [이미지] Migrate_to_s3 fails Self-hosting You can first try to run it with: SKIP_FAILED=1 rake uploads:migrate_to_s3. If that doesn’t work edit this line here and try again

Unfortunately I did try it with skip one and then it failed in the similar way. Could try again and get that error log. That upload is definitely not critical, in any case

Just edit your local copy of migrator as suggested in the topic. The value needs to be changed from 0 to 1 (since you have just one failing) this would fool the migrator into completion except for the one problem upload.

root@vps-9d50af6e:/var/discourse# ./launcher enter app x86_64 arch detected. root@vps-9d50af6e-app:/var/www/discourse# sed -i '85s/0/100/' lib/file_store/to_s3_migration.rb root@vps-9d50af6e-app:/var/www/discourse# sed -i '77s/0/100/' lib/file_store/to_s3_migration.rb root@vps-9d50af6e-app:/var/www/…

So why doesn’t the skip-failed work? What could I try next? How to check what wasn’t uploaded? Could this be because of some plugins?

Bumping, maybe someone else is going to see it and - hopefully - come up with an idea what could work

I’m gonna add - what I think is an answer - but it doesn’t work great. It is something I’m gonna try in the future though: Doing fresh installation with S3 + CDN, out of the box, Moving all of the uploads from current server to S3, Restoring from backup from old server, Changing app.yml to newer o…

16551개 업로드 중 1개가 S3로 마이그레이션되지 않았습니다. 'default' DB의 S3 마이그레이션 실패

제품 지원 자체 호스팅

itsbhanusharma (Bhanu Sharma) 2월 21, 2023, 6:40오후 6

그 1개의 업로드가 절대적으로 중요하지 않다면, 아래가 해결책입니다:

글		댓글	조회수
Migrate_to_s3 fails Self-hosting s3	25	2420	2월 21, 2022
Rake uploads:migrate_from_s3 fails Self-hosting s3	31	3530	4월 24, 2021
Rake uploads:migrate_to_s3 error Self-hosting s3	8	995	1월 6, 2020
Migrate_to_S3 Fails on Rebake Self-hosting	17	2847	9월 10, 2022
Uploads migration to S3 fails Product Support	26	3592	5월 7, 2021

16551개 업로드 중 1개가 S3로 마이그레이션되지 않았습니다. 'default' DB의 S3 마이그레이션 실패

Related topics