# Extend S3 configuration for other S3 API compatible services
**URL:** https://meta.discourse.org/t/extend-s3-configuration-for-other-s3-api-compatible-services/90371
**Category:** Feature
**Created:** [June 21, 2018, 7:10am UTC](https://meta.discourse.org/t/extend-s3-configuration-for-other-s3-api-compatible-services/90371 "2018-06-21T07:10:42Z")
**Posts on this page:** 18
**Page:** 3
### Author:  [@rishabh](https://meta.discourse.org/u/rishabh)
#### Post date: [July 16, 2018, 12:56pm UTC](https://meta.discourse.org/t/extend-s3-configuration-for-other-s3-api-compatible-services/90371/41 "2018-07-16T12:56:48Z")
I’ve almost finished writing the tutorial, it’ll be up on Meta very soon!
**Edit:** For everyone following this thread, here’s a link to the tutorial: 🎉
> [@(Superseded) Set up backup and image uploads to DigitalOcean Spaces](https://meta.discourse.org/t/setting-up-backup-and-image-uploads-to-digitalocean-spaces/92502):
>
> This topic is superseded by [Configure an S3 compatible object storage provider for uploads](https://meta.discourse.org/t/using-object-storage-for-uploads-s3-clones/148916).
---
### Author:  [@ckshen](https://meta.discourse.org/u/ckshen)
#### Post date: [July 18, 2018, 10:56pm UTC](https://meta.discourse.org/t/extend-s3-configuration-for-other-s3-api-compatible-services/90371/42 "2018-07-18T22:56:55Z")
I am going to try to migrate my existing images on S3 to Digital Ocean Spaces. An obvious path is to use the rake tasks to move the images back to the DO droplet and then run a eventually-available rake task to move the images from the DO droplet to DO Spaces. Since my droplet doesn’t have enough space for all the S3 images, I’ve come up a potential idea that lets me bypass my droplet’s space constraint. Can anyone comment whether it would work, or share if you see obvious issues?
The idea:
- Download all S3 images into my own hard drive, then upload them all into Digital Ocean spaces, maintaining all folder structure.
- Use a SQL query to change the ‘url’ of any file in the ‘uploads’ table from the S3 domain to the DO Space domain
That seems to be a faster way to do things, since the migration rake tasks had been very slow for me in the past, like 1mb / second.
I can try with one file, but want to ask anyone sees any obvious issues before I try it.
Thanks!
---
### Author:  [@pfaffman](https://meta.discourse.org/u/pfaffman)
#### Post date: [July 19, 2018, 5:28am UTC](https://meta.discourse.org/t/extend-s3-configuration-for-other-s3-api-compatible-services/90371/43 "2018-07-19T05:28:43Z")
You could create additional space with digital Ocean whatever they call the bigger space you can attach. That’d be much simpler.
---
### Author:  [@ckshen](https://meta.discourse.org/u/ckshen)
#### Post date: [July 19, 2018, 5:43am UTC](https://meta.discourse.org/t/extend-s3-configuration-for-other-s3-api-compatible-services/90371/44 "2018-07-19T05:43:16Z")
The only issue is the upsizing is permanent. And if I want to scale down the size afterwards, I have to migrate the forum to another droplet. I am not sure how involved that is.
---
### Author:  [@pfaffman](https://meta.discourse.org/u/pfaffman)
#### Post date: [July 19, 2018, 6:43am UTC](https://meta.discourse.org/t/extend-s3-configuration-for-other-s3-api-compatible-services/90371/45 "2018-07-19T06:43:10Z")
No. You can add just extra space in a separate partition. It’s on the same menu where you’d add a droplet.
---
### Author:  [@ckshen](https://meta.discourse.org/u/ckshen)
#### Post date: [July 19, 2018, 3:35pm UTC](https://meta.discourse.org/t/extend-s3-configuration-for-other-s3-api-compatible-services/90371/46 "2018-07-19T15:35:07Z")
Oh, yes. I forgot to say that my droplet is in a region where there is no block storage available. To do that I have to set up a new droplet and migrate the droplet over.
---
### Author:  [@pfaffman](https://meta.discourse.org/u/pfaffman)
#### Post date: [July 19, 2018, 3:38pm UTC](https://meta.discourse.org/t/extend-s3-configuration-for-other-s3-api-compatible-services/90371/47 "2018-07-19T15:38:17Z")
Oh. Bummer. Sorry, I forgot that some regions don’t have block storage (as you might guess since I can’t even remember what they call it!). If I understand your situation, though, I’d be inclined to move to one that does have block storage.
---
### Author:  [@Falco](https://meta.discourse.org/u/Falco)
#### Post date: [July 19, 2018, 5:05pm UTC](https://meta.discourse.org/t/extend-s3-configuration-for-other-s3-api-compatible-services/90371/48 "2018-07-19T17:05:04Z")
> [@ckshen](#):
>
> I am going to try to migrate my existing images on S3 to Digital Ocean Spaces.
> **[How To Migrate from Amazon S3 to DigitalOcean Spaces with rclone | DigitalOcean](https://www.digitalocean.com/community/tutorials/how-to-migrate-from-amazon-s3-to-digitalocean-spaces-with-rclone)**
>
> DigitalOcean Spaces is an object storage service designed to make it easy and cost effective to store and serve large amounts of data. If you have previously…
---
### Author:  [@hosna](https://meta.discourse.org/u/hosna)
#### Post date: [August 15, 2018, 8:02pm UTC](https://meta.discourse.org/t/extend-s3-configuration-for-other-s3-api-compatible-services/90371/49 "2018-08-15T20:02:06Z")
can we use minio instead of digital ocean?
---
### Author:  [@sam](https://meta.discourse.org/u/sam)
#### Post date: [August 15, 2018, 11:38pm UTC](https://meta.discourse.org/t/extend-s3-configuration-for-other-s3-api-compatible-services/90371/50 "2018-08-15T23:38:17Z")
> [@hosna](#):
>
> can we use minio instead of digital ocean?
Yes this has been tested @rishabh can you update details both here and at: [Minio instead of S3?](https://meta.discourse.org/t/minio-instead-of-s3/68815)
---
### Author:  [@rishabh](https://meta.discourse.org/u/rishabh)
#### Post date: [August 16, 2018, 5:33am UTC](https://meta.discourse.org/t/extend-s3-configuration-for-other-s3-api-compatible-services/90371/51 "2018-08-16T05:33:16Z")
I need one more day to finish it, it’s a bit longer than the s3 guide. I’ll update the details in both places 👍
---
### Author:  [@hosna](https://meta.discourse.org/u/hosna)
#### Post date: [August 19, 2018, 7:49pm UTC](https://meta.discourse.org/t/extend-s3-configuration-for-other-s3-api-compatible-services/90371/52 "2018-08-19T19:49:50Z")
Can we also migrate previous data from our server to minio?
---
### Author:  [@Falco](https://meta.discourse.org/u/Falco)
#### Post date: [August 19, 2018, 8:19pm UTC](https://meta.discourse.org/t/extend-s3-configuration-for-other-s3-api-compatible-services/90371/53 "2018-08-19T20:19:49Z")
Migrate from s3 or from local?
---
### Author:  [@hosna](https://meta.discourse.org/u/hosna)
#### Post date: [August 19, 2018, 8:20pm UTC](https://meta.discourse.org/t/extend-s3-configuration-for-other-s3-api-compatible-services/90371/54 "2018-08-19T20:20:44Z")
migrate from local to minio
---
### Author:  [@rishabh](https://meta.discourse.org/u/rishabh)
#### Post date: [August 19, 2018, 9:33pm UTC](https://meta.discourse.org/t/extend-s3-configuration-for-other-s3-api-compatible-services/90371/55 "2018-08-19T21:33:42Z")
@hosna This should help you set up Minio uploads/backups:
[https://meta.discourse.org/t/setting-up-backup-and-image-uploads-to-minio-s3/95123](https://meta.discourse.org/t/setting-up-backup-and-image-uploads-to-minio-s3/95123)
Note: I’ll be adding a section for enabling HTTPS on a Minio Server very soon!
---
### Author:  [@hawm](https://meta.discourse.org/u/hawm)
#### Post date: [September 27, 2018, 5:00am UTC](https://meta.discourse.org/t/extend-s3-configuration-for-other-s3-api-compatible-services/90371/56 "2018-09-27T05:00:25Z")
Does it as a plugin form better than build-in? More explain about the upload or some new API expose make it flex.
---
### Author:  [@Falco](https://meta.discourse.org/u/Falco)
#### Post date: [April 22, 2020, 10:58pm UTC](https://meta.discourse.org/t/extend-s3-configuration-for-other-s3-api-compatible-services/90371/57 "2020-04-22T22:58:33Z")
A guide and a list of compatible services lives at [Using Object Storage for Uploads (S3 Clones)](https://meta.discourse.org/t/using-object-storage-for-uploads-s3-clones/148916).
---
### Author:  [@Falco](https://meta.discourse.org/u/Falco)
#### Post date: [April 22, 2020, 10:58pm UTC](https://meta.discourse.org/t/extend-s3-configuration-for-other-s3-api-compatible-services/90371/58 "2020-04-22T22:58:36Z")
[Previous page](https://meta.discourse.org/t/extend-s3-configuration-for-other-s3-api-compatible-services/90371.md?page=2)