从 S3 迁移到 Spaces

支持 安装
1

我正在尝试制定一个从 AWS S3 迁移到 DO Spaces 以用于备份和上传的低风险策略。最初，我打算采用“长”流程，即：

  • 将上传内容迁移到本地
  • 移除旧的 S3 配置
  • 添加新的 DO Spaces 配置
  • 将数据迁移到 Spaces

另一种方案是启动一个备用容器并将其配置为使用 DO Spaces，但我认为将备份导入其中可能会直接覆盖现有设置，导致其再次连接到 S3。

不过，我很好奇是否有更快捷的方式，例如使用类似 S3CMD 的工具将资产从 S3 迁移到 DO，然后仅更改配置以链接到 DO？

对此有什么建议吗？可能存在哪些潜在风险？

2

Bhanu, what’s your driver for moving?

3

Experimentation primarily

Then cost effectiveness.

4

My AWS free tier comes to an end soon … need to think about these things too!

5

Mine has expired recently so Iooking for some cost cutting.

6

Did you try How To Migrate from Amazon S3 to DigitalOcean Spaces with rclone | DigitalOcean first?

7

I have in past migrated data from S3 to Spaces using S3CMD and I assume it will go through just fine with rclone as well! What I’m more concerned about is rewrites here! Specifically because currently I’m using S3 in addition with CloudFront but I plan to switching to Google Cloud CDN or fastly once my assets have been migrated.

8

Update: I Moved uploads to local today and the first thing that I’ve come across is that assets (despite being migrated from s3 to local) are taking a long time to be served locally. I don’t want to risk breaking things so presumably I’ll have to wait a few hours until all the uploads are being served from my forum then only I can proceed to setting up DO Spaces!

9

DigitalOcean 似乎不太擅长运行 Ceph（他们用于 Spaces 的软件）。其阿姆斯特丹 3 号数据中心的集群目前问题频发，备份经常超时。我原本对这款产品寄予厚望，但目前并不推荐。

10

同意，出于稳定性的考虑，我也推荐使用 S3 而不是 Spaces。我在 DigitalOcean Spaces 上遇到过延迟问题，而我们论坛所使用的 S3 + CloudFront 架构则没有这种情况。