Cyberduck Mountain Duck CLI

Opened 2 years ago

Closed 2 years ago

Last modified 2 years ago

#9585 closed enhancement (fixed)

Deleting multiple files concurrently

Reported by: drsassafras Owned by: dkocher
Priority: normal Milestone: 5.0.3
Component: sftp Version: 5.0
Severity: normal Keywords:
Cc: Architecture:
Platform:

Description

I have been deleting some large subdirectories (10,000+ files) and it takes SO LONG! Instead of the current way cyberduck deletes files, can it just send a unix delete command (rm -rf)

I figure it might work where archives can be expanded.

Thanks

Change History (6)

comment:1 Changed 2 years ago by dkocher

  • Component changed from core to sftp
  • Owner set to dkocher
  • Summary changed from Deleting takes FOREVER with large subdirectories to Deleting takes long with large subdirectories

Unfortunately there is no recursive option available in the SFTP protocol.

comment:2 Changed 2 years ago by dkocher

But we might want to implement concurrent requests executed in parallel when deleting multiple files. We currently do this for Backblaze B2.

comment:3 Changed 2 years ago by drsassafras

That would probably work really well. Deleting files is mostly a handshake, not much actual data is being sent. 5-10 concurrent deleting attempts would likely not stress an internet connection, but would make a 10hr deleting process take 1-2hrs!

Last edited 2 years ago by drsassafras (previous) (diff)

comment:4 Changed 2 years ago by dkocher

  • Milestone set to 5.0.2
  • Resolution set to fixed
  • Status changed from new to closed

In r20841.

comment:5 Changed 2 years ago by dkocher

  • Milestone changed from 5.0.2 to 5.0.3
  • Summary changed from Deleting takes long with large subdirectories to Deleting multiple files concurrently

comment:6 Changed 2 years ago by dkocher

Revised fix in r20891.

Note: See TracTickets for help on using tickets.
swiss made software