Migrate_to_s3 fails

Falco · February 18, 2022, 3:04pm

You can first try to run it with: SKIP_FAILED=1 rake uploads:migrate_to_s3.

If that doesn’t work edit this line here and try again

discourse/discourse/blob/main/lib/file_store/to_s3_migration.rb#L77

      
        
            end
            
            
def migration_successful?(should_raise: false)
              success = true
            
            
  failure_message = "S3 migration failed for db '#{@current_db}'."
              prefix = @migrate_to_multisite ? "uploads/#{@current_db}/original/" : "original/"
            
            
  base_url = File.join(SiteSetting.Upload.s3_base_url, prefix)
              count = Upload.by_users.where("url NOT LIKE '#{base_url}%'").count
              if count > 0
                error_message = "#{count} of #{Upload.count} uploads are not migrated to S3. #{failure_message}"
                raise_or_log(error_message, should_raise)
                success = false
              end
            
            
  cdn_path = SiteSetting.cdn_path("/uploads/#{@current_db}/original").sub(/https?:/, "")
              count = Post.where("cooked LIKE '%#{cdn_path}%'").count
              if count > 0
                error_message = "#{count} posts are not remapped to new S3 upload URL. #{failure_message}"
                raise_or_log(error_message, should_raise)

Topic		Replies	Views
1 of 16551 uploads are not migrated to S3. S3 migration failed for db 'default' installation cdn , s3	22	1405	August 10, 2023
Uploads migration to S3 fails support	26	2786	May 7, 2021
Migrating Site to S3 installation s3	2	650	May 25, 2020
Rake uploads:migrate_from_s3 fails installation s3	31	2617	April 24, 2021
Rake uploads:migrate_to_s3 error installation s3	8	708	January 6, 2020

Migrate_to_s3 fails

Related Topics