从 S3 迁移到 Spaces

我正在尝试制定一个从 AWS S3 迁移到 DO Spaces 以用于备份和上传的低风险策略。最初,我打算采用“长”流程,即:

  • 将上传内容迁移到本地
  • 移除旧的 S3 配置
  • 添加新的 DO Spaces 配置
  • 将数据迁移到 Spaces

另一种方案是启动一个备用容器并将其配置为使用 DO Spaces,但我认为将备份导入其中可能会直接覆盖现有设置,导致其再次连接到 S3。

不过,我很好奇是否有更快捷的方式,例如使用类似 S3CMD 的工具将资产从 S3 迁移到 DO,然后仅更改配置以链接到 DO?

对此有什么建议吗?可能存在哪些潜在风险?

3 个赞

Bhanu, what’s your driver for moving?

Experimentation primarily

Then cost effectiveness.

1 个赞

My AWS free tier comes to an end soon … need to think about these things too!

1 个赞

Mine has expired recently so Iooking for some cost cutting.

1 个赞

Did you try How To Migrate from Amazon S3 to DigitalOcean Spaces with rclone | DigitalOcean first?

4 个赞

I have in past migrated data from S3 to Spaces using S3CMD and I assume it will go through just fine with rclone as well! What I’m more concerned about is rewrites here! Specifically because currently I’m using S3 in addition with CloudFront but I plan to switching to Google Cloud CDN or fastly once my assets have been migrated.

2 个赞

Update: I Moved uploads to local today and the first thing that I’ve come across is that assets (despite being migrated from s3 to local) are taking a long time to be served locally. I don’t want to risk breaking things so presumably I’ll have to wait a few hours until all the uploads are being served from my forum then only I can proceed to setting up DO Spaces!

It doesn’t look like digitalocean is very good at running ceph (the software that they use for spaces). Their ams3 data center’s cluster is pretty broken now. Backups fairly regularly time out. I was very hopeful about this product but am not recommending it at right now.

3 个赞

Agreed, I’d recommend S3 over Spaces for sanity reasons too. I’ve had latency issues with DO Spaces which isn’t the case where I use the S3+CloudFront set up that powers our forum.

3 个赞