Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Segmented downloads with multiple connections per file #4498

Closed
cyberduck opened this issue May 27, 2010 · 18 comments
Closed

Segmented downloads with multiple connections per file #4498

cyberduck opened this issue May 27, 2010 · 18 comments
Assignees
Milestone

Comments

@cyberduck
Copy link
Collaborator

20868bf created the issue

Cyberduck does not seem capable of multi-segmenting files in FTP transfer. Consequently, for servers using this method of transfer, files being transferred via Cyberduck do not make full use of bandwidth and transfer far slower than they should. Although I have donated to Cyberduck development because I believe it is a very nice product, I found that for my needs, a product called Speed Download by Yazsoft does provide for multi-segmented transfers at far faster speed.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Actually a duplicate for #1135.

@cyberduck
Copy link
Collaborator Author

6caada9 commented

Segmented download is not the same as multi-connections (#1135) though it does depend on it... With segmented downloads a single large file is downloaded in several parts each using a separate connection. Multiple other download clients now support this - will CyberDuck support this in future?

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Duplicate for #1135. We have implemented multiple connections per transfer but it is not currently enabled by default.

@cyberduck
Copy link
Collaborator Author

6caada9 commented

lol - this is explicitly NOT the same as #1135! If you don't want to do it that's your prerogative but at least take the time to understand the request!

@cyberduck
Copy link
Collaborator Author

6caada9 commented

https://whatbox.ca/wiki/Multi-threaded_and_Segmented_FTP is a good description of the difference.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Replying to [comment:6 ajostergaard]:

lol - this is explicitly NOT the same as #1135! If you don't want to do it that's your prerogative but at least take the time to understand the request!

Sorry I was just skimming over and not reading properly.

@cyberduck
Copy link
Collaborator Author

1ab0d44 commented

A thumbs up for implementing segmented downloads.
-Parallel threads downloading different parts of the same files which are assembled when the download has completed - enabling a 100mbit connection (becoming more frequent) to max out the transfer speed rather than be limited by latency.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

In efb9fc6. The feature is not currently enabled by default. To enable, set the hidden settings queue.download.segments.threshold=0 and queue.session.pool.size=2 for two concurrent connections. When using the CLI run with env "queue.download.segments.threshold=0" env "queue.session.pool.size=1" duck ….

@cyberduck
Copy link
Collaborator Author

6caada9 commented

Thank you! :)

@cyberduck
Copy link
Collaborator Author

1ab0d44 commented

Fantastic that the feature is now in the code, thank you so so much.
Would it be possible to add access to it via the GUI ?

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Replying to [comment:14 bobthebuilder]:

Fantastic that the feature is now in the code, thank you so so much.
Would it be possible to add access to it via the GUI ?

We will have to let the new feature bake for 4.7 until we will make it available through the user interface.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Make sure to use e6dcee6 which includes an important fix.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

As of 9deb42f use the setting queue.transfer.type.enabled to enable the option for concurrent connections in the Preferences → Transfers → Transfer Files… and the bookmark settings.

defaults write ~/Library/Preferences/ch.sudo.cyberduck.plist queue.transfer.type.enabled "newconnection browser concurrent" 

This will add the option Open multiple connections. Use the setting Number of concurrent transfers to control the number of parallel connections.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Enabled in 5aeeb69.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Disabled by default in 02ef4f8. Set the hidden configuration option queue.download.segments to true to enable.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Reopen this issue to enable by default and add configuration option.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Milestone renamed

@cyberduck
Copy link
Collaborator Author

@dkocher commented

In 4f748a8.

@iterate-ch iterate-ch locked as resolved and limited conversation to collaborators Nov 26, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants