I’m trying to move uploads to s3 on a relatively busy site. Everything goes as planned except when I run rake uploads:migrate_to_s3, I am presented with the following error: Updating the URLs in the database... Removing old optimized images... Flagging all posts containing lightboxes for rebake...…

Looking at the error message from your previous post, it’s the count on line 85 which is of interest. @Falco ’s suggestion for editing the script is to increase that count to ignore some number of failures. The simplest way to achieve that is by entering the container and using sed to make an in-pla…

Hi @Simon_Manning I tried your suggestions, Sadly, no luck finding anything relevant in error logs. I do see an entry like Failed to optimize image: unknown reason but it doesn’t give me any more info than what it says. I tried your suggested query as well, I do get a bunch of posts as a result b…

I think I would expect to see something like that for 18 of those 19 posts, maybe even all 19 if the one failed upload happens to be in a post with multiple uploads. What might be easier is to pull out all the filenames from the query result (e.g. f8a2d9381889b8693db2777acac566bd7b134fa5.png) and s…

So I found the culprit, How do I proceed? What seems logical to me might not be the best way out Here are the options that I see: Remove reference of file from the offending post Delete file from the server remap the file link to something generic or maybe I’m thinking totally wrong?

If there’s not an obvious solution to get it to upload successfully, either of options 1 or 3 seem like good ways to go. 2 I would probably leave to Discourse, specifically the job to clean up orphaned uploads, the interval for which is controlled by the clean orphan uploads grace period hours setti…

Something else you could try after having removed the file and completed the migration (and having downloaded the failing file) is to edit the post again to put the file back in. It’d be interesting to know if it fails to upload to S3 entirely or only during the migration task.

I got the same error, on 64 post. Impossible to find them on 80K files… What would happen if I delete local files (most of them are alredy migrated)?

I confirm that files are migrated, but I got the same error.

Any suggestions? Uploads are on s3 and work fine, but the task: migrate to s3 fails.

[图片] Saiano: I got the same error, on 64 post. Impossible to find them on 80K files If you are okay with losing those 64 files, what I did when this same rake task kept failing on me is to edit it, and make it error inly if there are 100 errors instead of 1.

[图片] Falco: f you are okay with losing those 64 files, what I did when this same rake task kept failing on me is to edit it, and make it error inly if there are 100 errors instead of 1. It would be fine for me. What Shoud I do to edit the task?

Migrate_to_s3 失败

支持安装

Saiano (Saiano) 2022 年2 月 17 日 10:02 10

我遇到了同样的错误，在 64 个帖子上。在 80K 文件中找不到它们……

如果我删除本地文件（其中大部分已迁移），会发生什么？

话题		回复	浏览量
1 of 16551 uploads are not migrated to S3. S3 migration failed for db 'default' Self-hosting cdn , s3	21	2024	2023 年7 月 11 日
Uploads migration to S3 fails Support	26	3520	2021 年5 月 7 日
Migrating old uploads to S3 Self-hosting s3	8	1734	2021 年5 月 11 日
Rake uploads:migrate_from_s3 fails Self-hosting s3	31	3445	2021 年4 月 24 日
Rake migrate_to_s3 errors Self-hosting s3	3	824	2020 年2 月 4 日

Migrate_to_s3 失败

相关话题