Can't rebuild due to AWS SDK gem bump and new AWS Data Integrity Protections

Falco · February 26, 2025, 3:27am

Yeah, and AWS SDK maintainers are only giving us the cold shoulder on this

github.com/aws/aws-sdk-js-v3

s3.deleteObjects sends CRC32 checksum even if `requestChecksumCalculation` is set to `WHEN_REQUIRED`

opened 06:29PM - 17 Jan 25 UTC

closed 08:12PM - 17 Jan 25 UTC

trivikr

guidance

### Checkboxes for prior research - [x] I've gone through [Developer Guide](htt…ps://docs.aws.amazon.com/sdk-for-javascript/v3/developer-guide) and [API reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest) - [x] I've checked [AWS Forums](https://forums.aws.amazon.com) and [StackOverflow](https://stackoverflow.com/questions/tagged/aws-sdk-js). - [x] I've searched for [previous similar issues](https://github.com/aws/aws-sdk-js-v3/issues) and didn't find any solution. ### Describe the bug s3.deleteObjects sends CRC32 checksum even if `requestChecksumCalculation` is set to `WHEN_REQUIRED` ### Regression Issue - [x] Select this option if this issue appears to be a regression. ### SDK version number @aws-sdk/client-s3@2.729.0 ### Which JavaScript Runtime is this issue in? Node.js ### Details of the browser/Node.js/ReactNative version All ### Reproduction Steps ```js import { S3 } from "@aws-sdk/client-s3"; import { NodeHttpHandler } from "@smithy/node-http-handler"; class CustomHandler extends NodeHttpHandler { constructor() { super(); } printChecksumHeaders(prefix, headers) { for (const [header, value] of Object.entries(headers)) { if ( header === "content-md5" || header.startsWith("x-amz-checksum-") || header.startsWith("x-amz-sdk-checksum-") ) { console.log(`${prefix}['${header}']: '${value}'`); } } } async handle(request, options) { this.printChecksumHeaders("request", request.headers); const response = await super.handle(request, options); this.printChecksumHeaders("response", response.response.headers); return response; } } const client = new S3({ requestHandler: new CustomHandler(), requestChecksumCalculation: "WHEN_REQUIRED", }); const Bucket = "test-flexible-checksums-v2"; // Update to your test bucket name. const prepareClient = new S3(); // Populate an object in the bucket, as deleteObjects requires at least one. await prepareClient.putObject({ Bucket, Key: "helloworld.txt", Body: "helloworld" }); // Get list of objects to delete. const response = await prepareClient.listObjectsV2({ Bucket }); const Objects = response.Contents.map(({ Key }) => ({ Key })); await client.deleteObjects({ Bucket, Delete: { Objects } }); ``` ### Observed Behavior The CRC32 checksum is sent even if `requestChecksumCalculation` is set to `WHEN_REQUIRED` ```console $ node test.mjs request['x-amz-sdk-checksum-algorithm']: 'CRC32' request['x-amz-checksum-crc32']: 'uDrkBQ==' ``` ### Expected Behavior When `requestChecksumCalculation` is set to `WHEN_REQUIRED`, should it send `md5` like it was done in `<=v3.729.0`? Example output in `v3.726.0` ```console $ node test.mjs request['content-md5']: 'rl/UEqX25ygZIHP8TWK6/g==' ``` ### Possible Solution _No response_ ### Additional Information/Context _No response_

Topic		Replies	Views
Error Upgrading from 3.4.0.beta4-dev to 3.5.0.beta1 Support	3	105	April 5, 2025
Configure an S3 compatible object storage provider for uploads Self-Hosting configuring , reference , how-to , cdn	260	43243	October 28, 2025
Rake uploads:migrate_to_s3 error Installation s3	8	789	January 6, 2020
Cannot upload or backup to Amazon S3 Installation backups , s3	4	2130	January 9, 2024
Stop using Amazon s3 for uploads Support	52	4794	August 22, 2021

Can't rebuild due to AWS SDK gem bump and new AWS Data Integrity Protections

Related topics