Cyberduck Mountain Duck CLI

#7879 closed defect (fixed)

file-segments are downloaded when downloading a container at the top level

Reported by: jpereira Owned by: dkocher
Priority: high Milestone: 4.4.4
Component: openstack Version: 4.4.3
Severity: major Keywords:
Cc: david.cole@… Architecture: Intel
Platform: Windows 7

Description (last modified by dkocher)

It appears that cyberduck is downloading the .file-segments folder along with the unsegmented large files when downloading container in its entirety.

This is extremely undesirable behaviour as your ending up with double the amount of data being transferred if you container consists purely of large objects.

We have been able to circumvent the issue by including .file-segments include the list of download filtered files Preferences → Transfers → Filter.

Fundamentally you want to decouple file segments from the users container, my short term suggestion would be to include .file_segments to the default list of filtered filter.

Longer term I would suggest getting taking the approach of creating .file-segments into its own container, a similar approach to the python swift client.

You could then put some logic in place to calculate the size of the container based on the external file segments container.

Quick note: This was testing on the 4.4.3 Stable build for windows however it may impact other platforms as I presume the logic is shared.

Change History (2)

comment:1 Changed on Apr 8, 2014 at 8:12:27 PM by dkocher

  • Description modified (diff)
  • Status changed from new to assigned

comment:2 Changed on Apr 8, 2014 at 8:18:00 PM by dkocher

  • Resolution set to fixed
  • Status changed from assigned to closed

Added to default regular expression download filter in r14462. Rewriting our segment feature to store segments in a different container is not currently an option.

Note: See TracTickets for help on using tickets.