PUTs fail to S3 with Request Error: Header "x-amz-content-sha256" set to the hex-encoded SHA256 hash ... AWS Version 4

[jamshid]

Something must be wrong with my macOS install? Writing a 100M file to Amazon S3 fails with:

Request Error: Header "x-amz-content-sha256" set to the hex-encoded SHA256 hash of the request payload is required for AWS Version 4 request signing, please set this on: PUT https://X.s3.amazonaws.com:443/test/duck_100M HTTP/1.1. Please contact your web hosting service provider for assistance.

I've reinstalled and confirmed Cyberduck 7.1.0 does not have this problem.

"defaults read ch.sudo.cyberduck" shows:

"s3.location" = "us-west-2"; "s3.signature.version" = AWS4HMACSHA256;

[dkocher]

I cannot reproduce this error. Can you please provide some log output.

[jamshid]

log showing weird AWSV4 sig error

[jamshid]

Thank you for investigating. I attached logs though I don't see these menu items in my Cyberduck: Action → Include Info Messages and Action → Include Debug Messages

Hopefully the logs are still useful, let me know if you want me to test anything else or gather more logs.

[dkocher]

Can you let me know if you can still reproduce with version 7.4.

[jamshid]

Same error with 7.4.0. Do you want another set of logs, were the previous logs helpful? If it's something in my config maybe you could tell me what to clear or I could attach the file?

[jamshid]

Aha a breakthrough! It appears to be specific to certain files. Download this file (100M of NULs) then try uploading to an Amazon S3 bucket. ​https://jam.cloud.caringo.com/public/duck_100M You should now see the V4 signature error related to "x-amz-content-sha256".

A colleague verified the same error with a 100MB random bytes file, so it seems more about the size than contents.

dd if=/dev/urandom of=Desktop/test-100M.out bs=1024k count=100

Hopefully you can see the bug now, let me know if you need anything. Thanks!

[dkocher]

I can reproduce the bug which should only affects files with exactly 104857600B in file length.

[yla]

In r49377.