Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multiple connections for transfers #1135

Closed
cyberduck opened this issue Jun 6, 2007 · 20 comments
Closed

Multiple connections for transfers #1135

cyberduck opened this issue Jun 6, 2007 · 20 comments
Assignees
Milestone

Comments

@cyberduck
Copy link
Collaborator

0302cb0 created the issue

There are numerous FTP clients, mostly for windows that already do this. I think a default number of FTP connections, that ANY server admin would not object to is, 2 connections. In fact another popular open source windows ftp program, Filezilla uses 2 connections by default. If you are connecting to a private server (company webserver or shared public hosting) it shouldn't matter the number of connections because there are a limited number of people who have access.

When this feature is implemented it would be advisable to have the ability to change the number of connections in the Properties menu. Also of course make it smart enough not to try to download the same file 2x, if you try to download one large file. It might also be possible to split large files into chunks and use the multiple connections to download the chunks and put them back together after they have been downloaded.

If Cyberduck had this ability it would greatly increase the speed of transfers. You could make one connection list directories and another start transferring files. It would also greatly increase the speed of cyberduck in such cases where there are a lot of small files to transfer. I think we can agree that a faster ducky would make everyone happy. :)

@cyberduck
Copy link
Collaborator Author

54285a4 commented

The preferable way of setting an option like this would be to have a global setting, and then bookmark specific settings if needed. Also, the ability to change it on the fly in a current connection would be ideal!

A feature like this in cyberduck would make it an absolutely ideal FTP client. As it stands, transferring lots of small files is a pain in the balls!

Thanks

Jan

@cyberduck
Copy link
Collaborator Author

Sh4 commented

I agree, this is a must-have feature for me as my dedicated server is throttling international connections to 200k / connection.
Using Filezilla on Windows I am able to max out my 100Mb link by increasing the connection number but Cyberduck is crippled like hell and my weekly 27Gb full DB backups are taking ages to download and archive.

@cyberduck
Copy link
Collaborator Author

Miguel commented

Please! this is a must for any ftp client. The time spent transferring small files would be hugely improved.

Please, at least someone tells us why this isn't being implemented

@cyberduck
Copy link
Collaborator Author

Garrett commented

I agree, this is a must have feature, and would push many user to strongly consider the donations, not having this makes uploads to sites like wordpress very very slow, with many small files it takes forever.

@cyberduck
Copy link
Collaborator Author

Miguel commented

Could any developer answer this? Is there any plan to implement it? Is there any problem keeping you from doing it?

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Replying to [comment:9 Miguel]:

Could any developer answer this? Is there any plan to implement it? Is there any problem keeping you from doing it?

I have not decided against implementing this but haven't found the time needed yet. It is a feature requiring a good amount of work.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

#4498 closed as duplicate.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

#5736 closed as duplicate.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

#5720 closed as duplicate.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

#7061 closed as duplicate.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Work in 8872244.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Fix in 1e765b4. Disabled by default. Use the hidden property defaults write ch.sudo.cyberduck queue.session.pool.size 5 and set this to an integer greater than 1 to have multiple connections.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

See Multiple connections per transfer on how to enable.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

#4498 closed as duplicate.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Added tests in 79b288c.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Reopen to enable by default in 4.7.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

As of 9deb42f use the setting queue.transfer.type.enabled to enable the option for concurrent connections in the Preferences → Transfers → Transfer Files… and the bookmark settings.

defaults write ~/Library/Preferences/ch.sudo.cyberduck.plist queue.transfer.type.enabled "newconnection browser concurrent" 

@cyberduck
Copy link
Collaborator Author

@dkocher commented

This will add the option Open multiple connections. Use the setting Number of concurrent transfers to control the number of parallel connections.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Enabled in 5aeeb69.

@cyberduck
Copy link
Collaborator Author

c79f38e commented

Replying to [comment:26 dkocher]:

This will add the option Open multiple connections. Use the setting Number of concurrent transfers to control the number of parallel connections.

Any way to set this higher than 9? I am not maximizing my bandwidth.

@iterate-ch iterate-ch locked as resolved and limited conversation to collaborators Nov 26, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants