Cyberduck Mountain Duck CLI

Opened 11 years ago

Closed 4 years ago

Last modified 2 years ago

#1135 closed enhancement (fixed)

Multiple connections for transfers

Reported by: llbbl Owned by: dkocher
Priority: normal Milestone: 4.7
Component: core Version: 3.0b3
Severity: major Keywords:
Cc: Architecture:
Platform:

Description

There are numerous FTP clients, mostly for windows that already do this. I think a default number of FTP connections, that *ANY* server admin would not object to is, 2 connections. In fact another popular open source windows ftp program, Filezilla uses 2 connections by default. If you are connecting to a private server (company webserver or shared public hosting) it shouldn't matter the number of connections because there are a limited number of people who have access.

When this feature is implemented it would be advisable to have the ability to change the number of connections in the Properties menu. Also of course make it smart enough not to try to download the same file 2x, if you try to download one large file. It might also be possible to split large files into chunks and use the multiple connections to download the chunks and put them back together after they have been downloaded.

If Cyberduck had this ability it would greatly increase the speed of transfers. You could make one connection list directories and another start transferring files. It would also greatly increase the speed of cyberduck in such cases where there are a lot of small files to transfer. I think we can agree that a faster ducky would make everyone happy. :)

Change History (28)

comment:1 Changed 11 years ago by irchs

The preferable way of setting an option like this would be to have a global setting, and then bookmark specific settings if needed. Also, the ability to change it on the fly in a current connection would be ideal!

A feature like this in cyberduck would make it an absolutely ideal FTP client. As it stands, transferring lots of small files is a pain in the balls!

Thanks

Jan

comment:2 Changed 10 years ago by dkocher

  • Component changed from ftp to core
  • Milestone set to 3.1
  • Priority changed from high to normal
  • Severity changed from major to normal
  • Status changed from new to assigned
  • Summary changed from Enable Concurrent/Multiple FTP Connections to Enable Concurrent/Multiple Connections for transfers

comment:3 Changed 10 years ago by dkocher

  • Milestone 3.0.2 deleted
  • Resolution set to wontfix
  • Status changed from assigned to closed

comment:4 Changed 10 years ago by anonymous

  • Resolution wontfix deleted
  • Status changed from closed to reopened

comment:5 Changed 10 years ago by Sh4

  • Component changed from core to ftp
  • Severity changed from normal to major
  • Version changed from 2.7.3 to 3.0b3

I agree, this is a must-have feature for me as my dedicated server is throttling international connections to 200k / connection. Using Filezilla on Windows I am able to max out my 100Mb link by increasing the connection number but Cyberduck is crippled like hell and my weekly 27Gb full DB backups are taking ages to download and archive.

comment:6 Changed 9 years ago by dkocher

  • Component changed from ftp to core

comment:7 Changed 9 years ago by Miguel

Please! this is a must for any ftp client. The time spent transferring small files would be hugely improved.

Please, at least someone tells us why this isn't being implemented

comment:8 Changed 9 years ago by Garrett

I agree, this is a must have feature, and would push many user to strongly consider the donations, not having this makes uploads to sites like wordpress very very slow, with many small files it takes forever.

comment:9 follow-up: Changed 9 years ago by Miguel

Could any developer answer this? Is there any plan to implement it? Is there any problem keeping you from doing it?

comment:10 in reply to: ↑ 9 Changed 9 years ago by dkocher

Replying to Miguel:

Could any developer answer this? Is there any plan to implement it? Is there any problem keeping you from doing it?

I have not decided against implementing this but haven't found the time needed yet. It is a feature requiring a good amount of work.

comment:11 Changed 8 years ago by dkocher

  • Summary changed from Enable Concurrent/Multiple Connections for transfers to Enable multiple connections for transfers

#4498 closed as duplicate.

comment:12 Changed 8 years ago by dkocher

  • Milestone set to 3.8

comment:13 Changed 7 years ago by dkocher

#5736 closed as duplicate.

comment:14 Changed 7 years ago by dkocher

#5720 closed as duplicate.

comment:15 Changed 7 years ago by dkocher

  • Milestone changed from 4.1 to 4.3

comment:16 Changed 6 years ago by dkocher

  • Milestone changed from 4.3 to 4.4

comment:17 Changed 6 years ago by dkocher

#7061 closed as duplicate.

comment:18 Changed 5 years ago by dkocher

  • Summary changed from Enable multiple connections for transfers to Multiple connections for transfers

comment:19 Changed 5 years ago by dkocher

Work in r13324.

comment:20 Changed 5 years ago by dkocher

  • Milestone changed from 5.0 to 4.4
  • Resolution set to fixed
  • Status changed from reopened to closed

Fix in r13342. Disabled by default. Use the hidden property defaults write ch.sudo.cyberduck queue.session.pool.size 5 and set this to an integer greater than 1 to have multiple connections.

comment:21 Changed 4 years ago by dkocher

See Multiple connections per transfer on how to enable.

comment:22 Changed 4 years ago by dkocher

#4498 closed as duplicate.

Last edited 4 years ago by dkocher (previous) (diff)

comment:23 Changed 4 years ago by dkocher

Added tests in r15075.

comment:24 Changed 4 years ago by dkocher

  • Milestone changed from 4.4 to 4.7
  • Resolution fixed deleted
  • Status changed from closed to reopened

Reopen to enable by default in 4.7.

comment:25 Changed 4 years ago by dkocher

  • Resolution set to fixed
  • Status changed from reopened to closed

As of r16903 use the setting queue.transfer.type.enabled to enable the option for concurrent connections in the Preferences → Transfers → Transfer Files… and the bookmark settings.

defaults write ~/Library/Preferences/ch.sudo.cyberduck.plist queue.transfer.type.enabled "newconnection browser concurrent" 

comment:26 follow-up: Changed 4 years ago by dkocher

This will add the option Open multiple connections. Use the setting Number of concurrent transfers to control the number of parallel connections.

comment:27 Changed 3 years ago by dkocher

Enabled in r16977.

comment:28 in reply to: ↑ 26 Changed 2 years ago by zeevg

Replying to dkocher:

This will add the option Open multiple connections. Use the setting Number of concurrent transfers to control the number of parallel connections.

Any way to set this higher than 9? I am not maximizing my bandwidth.

Note: See TracTickets for help on using tickets.
swiss made software