Migrate to minio

bug
1

I configured minio as image upload storage, it works well for new uploads, but I can’t migrate olds into that.

root@9c9267547230:/var/www/discourse# rake uploads:migrate_to_s3
Migrating uploads to S3 for 'default'...
Some uploads were not migrated to the new scheme. Please run these commands in the rails console

SiteSetting.migrate_to_new_scheme = true
Jobs::MigrateUploadScheme.new.execute(nil)

when I execute Jobs::MigrateUploadScheme.new.execute(nil) first time, it takes several hours and returned some exception, but seems finally success.

image
image2460×1370 790 KB

I execute it second time, it returns an empty array [].

image
image954×186 68.3 KB

and then I try to rake uploads:migrate_to_s3 again, it still says Some uploads were not migrated to the new scheme.

image
image1572×210 84.4 KB

3 Likes
2

they’re site icons.

image
image.jpg3510×308 269 KB

3

This is a known issue, already reported in the following topic:

It’s been a long time since it was promised to be fixed. However unfortunately it’s not fixed yet.

2 Likes
4

is there any known work-around solution?

5

I’m currently having a similar problem with Spaces.

3 Likes
6

I think It should be possible to manually transfer upload files from local to minio by minio client (mc). Then update links by a rake task. However I didn’t try it cause I cant risk it on my community.

In your case if its only a handful of site icons, maybe just upload them manually and update links in your dashboard.

2 Likes
7

So this is ultimately CORS related as well, @pfaffman?

1 Like
8

The problem that I think he was referring to is that migrate_to_s3 won’t run unless everything has been changed to the new scheme but the default/stock images are in the old scheme. And the process that updates them didn’t touch the stock images. (and if you run an update they get recreated)

1 Like
9

Can you update to latest and run the rake task again?

I fixed the rake task to only check for uploads made by users otherwise it wouldn’t run.

2 Likes
10

Oooh! . by_users! I didn’t know about that one. I’ll try to have a look, though it seems pretty clear they should fix it.

I suspect my task is still running.

11

That’s because it’s new-ish. Was added in

https://github.com/discourse/discourse/commit/b0c8fdd7da20fc4eeb30575050360fbf47ec4c8f

3 Likes
12

ooh sorry I have already migrated it manually and can’t do this again.

1 Like