Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failure to read attributes on S3 downloads (400 Bad Request on HEAD /DIR/file) #11196

Closed
cyberduck opened this issue Oct 8, 2020 · 15 comments
Closed
Assignees
Labels
bug fixed high priority s3 AWS S3 Protocol Implementation
Milestone

Comments

@cyberduck
Copy link
Collaborator

20dc817 created the issue

Using version 7.6.2 (33520), I am unable to download files from S3 buckets (it worked with previous versions).

I can list the contents of a bucket, but when I try [Action] -> [Download], I get the message:

Failure to read attributes of FILENAME.xml
Bad Request. Request Error. Please contact your web hosting service provider for assistance.

The log shows:

Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Server: AmazonS3
Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] HEAD /DIR/FILENAME.xml HTTP/1.1
Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Date: Thu, 08 Oct 2020 03:25:13 GMT
Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-content-sha256: ...
Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Host: my-bucket.s3.amazonaws.com
Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-date: 20201008T032513Z
Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Authorization: ********
Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Connection: Keep-Alive
Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] User-Agent: Cyberduck/7.6.2.33520 (Mac OS X/10.15.7) (x86_64)
Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] HTTP/1.1 400 Bad Request
Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-request-id: ...
Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-id-2: ...
Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Content-Type: application/xml
Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Transfer-Encoding: chunked
Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Date: Thu, 08 Oct 2020 03:25:13 GMT
Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Connection: close
Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Server: AmazonS3

For the S3 bucket, I used a standard access policy:

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Sid": "VisualEditor0",
            "Effect": "Allow",
            "Action": [
                "s3:GetObject",
                "s3:ListBucket"
            ],
            "Resource": [
                "arn:aws:s3:::my-bucket",
                "arn:aws:s3:::my-bucket/*"
            ]
        }
    ]
}
@cyberduck
Copy link
Collaborator Author

20dc817 commented

I also noticed the following:

  • The last version that works correctly is 7.4.0 (26 May 2020), while 7.4.1 (16 Jun 2020) introduces the problem.
  • All versions work if I paste a URL like s3://my-bucket.s3.amazonaws.com/my-bucket into the "Server" field of "Open Connection"
  • Instead, if I paste s3://my-bucket.s3.amazonaws.com and browse into the bucket, downloads fail with the error above

Workarounds:

@cyberduck
Copy link
Collaborator Author

@dkocher commented

What is the region of the bucket and its exact name and/or Host header sent? Please try to set keep the default hostname in the bookmark as s3.amazonaws.com and set the default path to the bucket name such as /my-bucket.

@cyberduck
Copy link
Collaborator Author

20dc817 commented

The bucket is in the us-west-2 region (Oregon).

We always used the default hostname s3.amazonaws.com, but

  • With the bucket name in the path (s3://my-bucket.s3.amazonaws.com/my-bucket) downloads work
  • Without the bucket name (s3://my-bucket.s3.amazonaws.com) we can connect and explore the bucket, but then downloads fail (with versions after 7.4.0)

The logs above show the Host header sent:

Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Host: my-bucket.s3.amazonaws.com

(the bucket name was replaced with my-bucket for privacy reasons)

@cyberduck
Copy link
Collaborator Author

@dkocher commented

I am unable to reproduce this with a test bucket in us-west-2.

2020-10-09 12:53:29.972438+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] HEAD /10-13.jpg HTTP/1.1
2020-10-09 12:53:29.972496+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Date: Fri, 09 Oct 2020 10:53:29 GMT
2020-10-09 12:53:29.972554+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2020-10-09 12:53:29.972641+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Host: test-us-west-2-cyberduck.s3.dualstack.us-west-2.amazonaws.com
2020-10-09 12:53:29.972701+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-date: 20201009T105329Z
2020-10-09 12:53:29.972784+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Authorization: ********
2020-10-09 12:53:29.973019+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Connection: Keep-Alive
2020-10-09 12:53:29.973146+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] User-Agent: Cyberduck/7.6.5.33571 (Mac OS X/10.15.6) (x86_64)

@cyberduck
Copy link
Collaborator Author

@dkocher commented

The reason for this error may be that we fail to determine the region for the bucket and then default to us-east-1. Can you make sure your IAM policy allows to determine the location of the bucket using s3:GetBucketLocation.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

You should see a request in the transcript where the bucket location is determined similar to

2020-10-09 12:53:29.218576+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] GET /?location HTTP/1.1
2020-10-09 12:53:29.218640+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Date: Fri, 09 Oct 2020 10:53:28 GMT
2020-10-09 12:53:29.218689+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2020-10-09 12:53:29.218733+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Host: test-us-west-2-cyberduck.s3.dualstack.us-east-1.amazonaws.com
2020-10-09 12:53:29.218773+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-date: 20201009T105328Z
2020-10-09 12:53:29.218822+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Authorization: ********
2020-10-09 12:53:29.219002+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Connection: Keep-Alive
2020-10-09 12:53:29.219061+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] User-Agent: Cyberduck/7.6.5.33571 (Mac OS X/10.15.6) (x86_64)
2020-10-09 12:53:29.329824+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] HTTP/1.1 200 OK
2020-10-09 12:53:29.329924+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-id-2: vu5yD5cynQkSbIW43SkCYj0wQ0Vrp8Jv1wg8d/5kN7ThMAl01fKc44ThzvEvPOtg7iuNgMGjp2s=
2020-10-09 12:53:29.329987+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-request-id: 3WAM2G2YDR4G8YCY
2020-10-09 12:53:29.330058+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Date: Fri, 09 Oct 2020 10:53:30 GMT
2020-10-09 12:53:29.330134+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Content-Type: application/xml
2020-10-09 12:53:29.330240+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Transfer-Encoding: chunked
2020-10-09 12:53:29.330298+0200 0x5dd7d4   Info        0x0                  9866   0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Server: AmazonS3

@cyberduck
Copy link
Collaborator Author

20dc817 commented

The problem is easily reproducible from my end and it persists even after adding the s3:GetBucketLocation permission.
I can provide login information to a test bucket.

The sequence of requests I see in the logs is

2020-10-09 11:16:09.760054-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] HEAD /test.txt HTTP/1.1
2020-10-09 11:16:09.760085-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Date: Fri, 09 Oct 2020 18:16:09 GMT
2020-10-09 11:16:09.760107-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-content-sha256: ...
2020-10-09 11:16:09.760122-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Host: cyberduck-x-test.s3.amazonaws.com
2020-10-09 11:16:09.760136-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-date: 20201009T181609Z
2020-10-09 11:16:09.760229-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Authorization: ********
2020-10-09 11:16:09.760247-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Connection: Keep-Alive
2020-10-09 11:16:09.760265-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] User-Agent: Cyberduck/7.6.2.33520 (Mac OS X/10.15.7) (x86_64)
2020-10-09 11:16:09.842002-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] HTTP/1.1 307 Temporary Redirect
2020-10-09 11:16:09.842027-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-bucket-region: us-west-2
2020-10-09 11:16:09.842038-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-request-id: ...
2020-10-09 11:16:09.842050-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-id-2: ...
2020-10-09 11:16:09.842061-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Location: https://cyberduck-x-test.s3-us-west-2.amazonaws.com/test.txt
2020-10-09 11:16:09.842098-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Content-Type: application/xml
2020-10-09 11:16:09.842110-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Transfer-Encoding: chunked
2020-10-09 11:16:09.842121-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Date: Fri, 09 Oct 2020 18:16:08 GMT
2020-10-09 11:16:09.842131-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Server: AmazonS3
2020-10-09 11:16:09.981394-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] HEAD /test.txt HTTP/1.1
2020-10-09 11:16:09.981418-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Date: Fri, 09 Oct 2020 18:16:09 GMT
2020-10-09 11:16:09.981439-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-content-sha256: ...
2020-10-09 11:16:09.981451-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Host: cyberduck-x-test.s3.amazonaws.com
2020-10-09 11:16:09.981463-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-date: 20201009T181609Z
2020-10-09 11:16:09.981504-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Authorization: ********
2020-10-09 11:16:09.981517-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Connection: Keep-Alive
2020-10-09 11:16:09.981530-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] User-Agent: Cyberduck/7.6.2.33520 (Mac OS X/10.15.7) (x86_64)
2020-10-09 11:16:10.092641-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] HTTP/1.1 400 Bad Request
2020-10-09 11:16:10.092673-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-request-id: ...
2020-10-09 11:16:10.092687-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-id-2: ...
2020-10-09 11:16:10.092698-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Content-Type: application/xml
2020-10-09 11:16:10.092719-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Transfer-Encoding: chunked
2020-10-09 11:16:10.092730-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Date: Fri, 09 Oct 2020 18:16:09 GMT
2020-10-09 11:16:10.092741-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Connection: close
2020-10-09 11:16:10.092752-0700 0x11a85e   Info        0x0                  36683  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Server: AmazonS3

@cyberduck
Copy link
Collaborator Author

48b9552 commented

I have also problems when using buckets in eu-west-3 with Version 7.7.0 (33744)

When using the default "S3 HTTPS" profile and using my-bucket.s3.amazonaws.com as server name, I can open a connection to the bucket, list files and upload some but it fails when trying to download any files (even the one I just uploaded) with a "Failure to read attributes". The 400 is due to "us-east-1" used as a region in AWSv4 signature on a HEAD request against the my-bucket.s3.amazonaws.com. All other requests seems good but not this one.

When using a custom profile forcing region to eu-west-3 (and still using my-bucket.s3.amazonaws.com as server name) it works unreliably. i.e. sometimes the created bookmark will work flawlessly
but sometimes it will loop on the first request which is a GET to https://s3.amazonaws.com/ but with region "eu-west-3" and s3.amazonaws.com wants eu-east-1 as a region so we have always 400, when in this state it loops forever and it is really difficult to start any other connection.
I don't know what I do differently between the creation of a bookmark which work and one which does not work. I think I do exactly the same steps on both cases but I am probably wrong somewhere.

This makes Cyberduck unusable for me.

@cyberduck
Copy link
Collaborator Author

48b9552 commented

As a side note I did not find how to get the cyberduck logs or transcripts. I resorted to mitmproxy to analyse. I think the wiki should explain how to easily get transcripts to ease bug reporting.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Replying to [comment:10 francoisj]:

As a side note I did not find how to get the cyberduck logs or transcripts. I resorted to mitmproxy to analyse. I think the wiki should explain how to easily get transcripts to ease bug reporting.

Refer to Provide log output.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Replying to [comment:9 francoisj]:

I have also problems when using buckets in eu-west-3 with Version 7.7.0 (33744)

When using the default "S3 HTTPS" profile and using my-bucket.s3.amazonaws.com as server name, I can open a connection to the bucket, list files and upload some but it fails when trying to download any files (even the one I just uploaded) with a "Failure to read attributes". The 400 is due to "us-east-1" used as a region in AWSv4 signature on a HEAD request against the my-bucket.s3.amazonaws.com. All other requests seems good but not this one.

When using a custom profile forcing region to eu-west-3 (and still using my-bucket.s3.amazonaws.com as server name) it works unreliably. i.e. sometimes the created bookmark will work flawlessly
but sometimes it will loop on the first request which is a GET to https://s3.amazonaws.com/ but with region "eu-west-3" and s3.amazonaws.com wants eu-east-1 as a region so we have always 400, when in this state it loops forever and it is really difficult to start any other connection.
I don't know what I do differently between the creation of a bookmark which work and one which does not work. I think I do exactly the same steps on both cases but I am probably wrong somewhere.

This makes Cyberduck unusable for me.

Please try to set the default hostname s3.amazonaws.com and set the bucket you want to connect to in the Default Path setting instead.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Also make sure the IAM permission allows to query the region of the bucket (s3:GetBucketLocation).

@cyberduck
Copy link
Collaborator Author

@dkocher commented

This is reproducible

2020-11-30 18:43:28.165232+0100 0x731ee3   Info        0x0                  24510  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] HEAD /IMG_4542.jpeg HTTP/1.1
2020-11-30 18:43:28.165303+0100 0x731ee3   Info        0x0                  24510  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Date: Mon, 30 Nov 2020 17:43:28 GMT
2020-11-30 18:43:28.165381+0100 0x731ee3   Info        0x0                  24510  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2020-11-30 18:43:28.165435+0100 0x731ee3   Info        0x0                  24510  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Host: test-eu-west-3-cyberduck.s3.amazonaws.com
2020-11-30 18:43:28.165484+0100 0x731ee3   Info        0x0                  24510  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-date: 20201130T174328Z
2020-11-30 18:43:28.165574+0100 0x731ee3   Info        0x0                  24510  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Authorization: ********
2020-11-30 18:43:28.165641+0100 0x731ee3   Info        0x0                  24510  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Connection: Keep-Alive
2020-11-30 18:43:28.165694+0100 0x731ee3   Info        0x0                  24510  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] User-Agent: Cyberduck/7.7.2.33846 (Mac OS X/10.15.7) (x86_64)
2020-11-30 18:43:28.183388+0100 0x731ee3   Info        0x0                  24510  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] HTTP/1.1 400 Bad Request
2020-11-30 18:43:28.183471+0100 0x731ee3   Info        0x0                  24510  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-request-id: 92CEB083181F824A
2020-11-30 18:43:28.183528+0100 0x731ee3   Info        0x0                  24510  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] x-amz-id-2: nryLGleSwyV+jFyTNEHMQS5etLG0TCyJTGmiPOe6q7owMMOiCEYP718Ztap6iJO4MfvKBR/xsTI=
2020-11-30 18:43:28.183566+0100 0x731ee3   Info        0x0                  24510  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Content-Type: application/xml
2020-11-30 18:43:28.183621+0100 0x731ee3   Info        0x0                  24510  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Date: Mon, 30 Nov 2020 17:43:27 GMT
2020-11-30 18:43:28.183692+0100 0x731ee3   Info        0x0                  24510  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Server: AmazonS3
2020-11-30 18:43:28.183772+0100 0x731ee3   Info        0x0                  24510  0    Cyberduck: (libcore.dylib) [ch.sudo.cyberduck:transcript] Connection: close

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Replying to [comment:12 dkocher]:

Replying to [comment:9 francoisj]:

I have also problems when using buckets in eu-west-3 with Version 7.7.0 (33744)

When using the default "S3 HTTPS" profile and using my-bucket.s3.amazonaws.com as server name, I can open a connection to the bucket, list files and upload some but it fails when trying to download any files (even the one I just uploaded) with a "Failure to read attributes". The 400 is due to "us-east-1" used as a region in AWSv4 signature on a HEAD request against the my-bucket.s3.amazonaws.com. All other requests seems good but not this one.

I can confirm this finding.

<Error><Code>AuthorizationHeaderMalformed</Code><Message>The authorization header is malformed; the region 'us-east-1' is wrong; expecting 'eu-west-3'</Message><Region>eu-west-3</Region><RequestId>976585D82B3A2013</RequestId><HostId>CA9d8EJFYNh6J7ewB0mf1Q1WhP29jRFsAt1rCDqympfWlOI6RzIiDFBL3GL2wXiNIWbMF5/KXHA=</HostId></Error>

@cyberduck
Copy link
Collaborator Author

@ylangisc commented

In 140828d.

@iterate-ch iterate-ch locked as resolved and limited conversation to collaborators Nov 27, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug fixed high priority s3 AWS S3 Protocol Implementation
Projects
None yet
Development

No branches or pull requests

2 participants