# Резервные копии несколько раз не удавалось загрузить в S3 — в итоге загрузка прошла успешно

**URL:** https://meta.discourse.org/t/backups-fail-to-upload-to-s3-several-times-works-eventually/366874
**Category:** Support
**Tags:** backups, s3
**Created:** [20.Май.2025 16:26:08 UTC](https://meta.discourse.org/t/backups-fail-to-upload-to-s3-several-times-works-eventually/366874 "2025-05-20T16:26:08Z")
**Posts on this page:** 1
**Showing post:** 1

<div class="post-metadata">

### Author: ![markschmucker](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/markschmucker/32/141599_2.png) [@markschmucker](https://meta.discourse.org/u/markschmucker)
#### Post date: [20.Май.2025 16:26:08 UTC](https://meta.discourse.org/t/backups-fail-to-upload-to-s3-several-times-works-eventually/366874/1 "2025-05-20T16:26:08Z")

</div>

Резервное копирование в S3 работало без сбоев в течение нескольких лет. Начиная с месяца назад, я часто получаю несколько уведомлений о том, что резервное копирование не удалось. Затем оно повторяет попытку, и примерно через час снова терпит неудачу, поэтому я получаю второе уведомление, и часто до шести уведомлений в день, прежде чем оно наконец завершится успешно.

В логе из уведомления указано, что не удалось загрузить сжатый tar-файл в S3. Я не могу найти никаких ошибок в своей учетной записи S3.

> **Лог**
>
> Первая часть лога выглядит нормально, затем:
> 
> [2025-05-20 07:11:38] Завершение резервного копирования…  
> [2025-05-20 07:11:38] Создание архива: 506-investor-group-2025-05-20-070428-v20250513161753.tar.gz  
> [2025-05-20 07:11:38] Проверка, не существует ли уже архив…  
> [2025-05-20 07:11:38] Создание пустого архива…  
> [2025-05-20 07:11:38] Архивирование дампа данных…  
> [2025-05-20 07:12:17] Архивирование загрузок…  
> [2025-05-20 07:15:48] Удаление временной директории ‘/var/www/discourse/tmp/backups/default/2025-05-20-070428’…  
> [2025-05-20 07:15:48] Сжатие архива в gzip, это может занять время…  
> [2025-05-20 07:32:51] Загрузка архива…  
> [2025-05-20 07:34:28] ИСКЛЮЧЕНИЕ: Sidekiq::Shutdown  
> [2025-05-20 07:34:28] /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/aws-sdk-s3-1.182.0/lib/aws-sdk-s3/multipart\_file\_uploader.rb:199:in `value' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/aws-sdk-s3-1.182.0/lib/aws-sdk-s3/multipart_file_uploader.rb:199:in `map’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/aws-sdk-s3-1.182.0/lib/aws-sdk-s3/multipart\_file\_uploader.rb:199:in `upload_in_threads' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/aws-sdk-s3-1.182.0/lib/aws-sdk-s3/multipart_file_uploader.rb:82:in `upload\_parts’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/aws-sdk-s3-1.182.0/lib/aws-sdk-s3/multipart\_file\_uploader.rb:59:in `upload' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/aws-sdk-s3-1.182.0/lib/aws-sdk-s3/file_uploader.rb:42:in `block in upload’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/aws-sdk-core-3.219.0/lib/aws-sdk-core/plugins/user\_agent.rb:69:in `metric' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/aws-sdk-s3-1.182.0/lib/aws-sdk-s3/file_uploader.rb:40:in `upload’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/aws-sdk-s3-1.182.0/lib/aws-sdk-s3/customizations/object.rb:477:in `block in upload_file' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/aws-sdk-core-3.219.0/lib/aws-sdk-core/plugins/user_agent.rb:69:in `metric’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/aws-sdk-s3-1.182.0/lib/aws-sdk-s3/customizations/object.rb:476:in `upload_file' /var/www/discourse/lib/backup_restore/s3_backup_store.rb:48:in `upload\_file’  
> /var/www/discourse/lib/backup\_restore/backuper.rb:351:in `upload_archive' /var/www/discourse/lib/backup_restore/backuper.rb:41:in `run’  
> /var/www/discourse/lib/backup\_restore.rb:13:in `backup!' /var/www/discourse/app/jobs/regular/create_backup.rb:10:in `execute’  
> /var/www/discourse/app/jobs/base.rb:316:in `block (2 levels) in perform' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/rails_multisite-6.1.0/lib/rails_multisite/connection_management/null_instance.rb:49:in `with\_connection’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/rails\_multisite-6.1.0/lib/rails\_multisite/connection\_management.rb:21:in `with_connection' /var/www/discourse/app/jobs/base.rb:303:in `block in perform’  
> /var/www/discourse/app/jobs/base.rb:299:in `each' /var/www/discourse/app/jobs/base.rb:299:in `perform’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/processor.rb:220:in `execute_job' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/processor.rb:185:in `block (4 levels) in process’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/middleware/chain.rb:180:in `traverse' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/middleware/chain.rb:183:in `block in traverse’  
> /var/www/discourse/lib/sidekiq/discourse\_event.rb:6:in `call' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/middleware/chain.rb:182:in `traverse’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/middleware/chain.rb:183:in `block in traverse' /var/www/discourse/lib/sidekiq/pausable.rb:131:in `call’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/middleware/chain.rb:182:in `traverse' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/middleware/chain.rb:183:in `block in traverse’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/job/interrupt\_handler.rb:9:in `call' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/middleware/chain.rb:182:in `traverse’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/middleware/chain.rb:183:in `block in traverse' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/metrics/tracking.rb:26:in `track’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/metrics/tracking.rb:134:in `call' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/middleware/chain.rb:182:in `traverse’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/middleware/chain.rb:173:in `invoke' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/processor.rb:184:in `block (3 levels) in process’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/job_retry.rb:118:in `local’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/config.rb:39:in `block in class:Config’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/processor.rb:281:in `stats’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/job_logger.rb:15:in `call’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/job_retry.rb:85:in `global’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/processor.rb:132:in `block in dispatch' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/job_logger.rb:40:in `prepare’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/processor.rb:131:in `dispatch' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/processor.rb:183:in `block (2 levels) in process’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/processor.rb:182:in `handle_interrupt' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/processor.rb:182:in `block in process’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/processor.rb:181:in `handle_interrupt' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/processor.rb:181:in `process’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/processor.rb:86:in `process_one' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/processor.rb:76:in `run’  
> /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/component.rb:10:in `watchdog' /var/www/discourse/vendor/bundle/ruby/3.3.0/gems/sidekiq-7.3.9/lib/sidekiq/component.rb:19:in `block in safe\_thread’  
> [2025-05-20 07:34:28] Удаление старых резервных копий…  
> [2025-05-20 07:34:28] Очистка…  
> [2025-05-20 07:34:28] Удаление архива из локального хранилища…  
> [2025-05-20 07:34:28] Удаление остатков ‘.tar’…  
> [2025-05-20 07:34:28] Пометка резервной копии как завершенной…  
> [2025-05-20 07:34:28] Уведомление ‘system’ об окончании резервного копирования…

У меня достаточно места на диске (свободного места в 6 раз больше, чем размер резервной копии).

Использование процессора за сегодня — резервное копирование должно занимать меньше часа, но когда приходится пытаться 9 раз, это занимает четыре часа:

 ![image](https://global.discourse-cdn.com/meta/original/4X/f/7/9/f798bd8bddc4bef4ac80263bb9c47efef59a4211.png)

---

_[View the full topic](https://meta.discourse.org/t/backups-fail-to-upload-to-s3-several-times-works-eventually/366874)._
