Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support multipart for copy transfer #9362

Closed
cyberduck opened this issue Mar 12, 2016 · 5 comments
Closed

Support multipart for copy transfer #9362

cyberduck opened this issue Mar 12, 2016 · 5 comments
Assignees
Labels
enhancement fixed s3 AWS S3 Protocol Implementation
Milestone

Comments

@cyberduck
Copy link
Collaborator

ca015dd created the issue

Cannot find anyone else with this problem in my google searches.

issue:
getting this error when trying to transfer an 8.2 GB file from an FTP server to AWS s3.

Your proposed upload exceeds the maximum allowed size. Please contact your web hosting service provider for assistance.

external image

The AMI user making the request has the following bucket policy:


{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Effect": "Allow",
            "Action": [
                "s3:ListBucket",
                "s3:ListBucketMultipartUploads"
            ],
            "Resource": [
                "arn:aws:s3:::my-bucket-name"
            ]
        },
        {
            "Effect": "Allow",
            "Action": [
                "s3:PutObject",
                "s3:GetObject",
                "s3:DeleteObject",
                "s3:AbortMultipartUpload",
                "s3:ListMultipartUploadParts"
            ],
            "Resource": [
                "arn:aws:s3:::my-bucket-name/*"
            ]
        }
    ]
}

I have already followed the instructions here to enable multipart upload. https://trac.cyberduck.io/wiki/help/en/howto/s3#MultipartUploads

Also I am running 4.8.3 on max OS X Yosemite 10.10.4

Not sure why this is happening, because before I modified my bucket policy to include multipart upload, I was getting an S3 access denied response. Once I changed the policy, the error switched to this. Perhaps it is because I am uploading from ftp -> s3 instead of from my desktop?

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Multipart uploads are enabled by default. Did you accidentally disable support for multipart upload by chance following the directions in the wiki?

@cyberduck
Copy link
Collaborator Author

ca015dd commented

Hey,

thanks for looking into this. The command I executed was:

defaults write ~/Library/Preferences/ch.sudo.cyberduck.plist s3.upload.multipart true

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Currently multipart is not supported when copying files – therefore the failure.

@cyberduck
Copy link
Collaborator Author

ca015dd commented

Okay thank you.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

In 17430cf.

@iterate-ch iterate-ch locked as resolved and limited conversation to collaborators Nov 26, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement fixed s3 AWS S3 Protocol Implementation
Projects
None yet
Development

No branches or pull requests

2 participants