You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It appears that cyberduck is downloading the .file-segments folder along with the unsegmented large files when downloading container in its entirety.
This is extremely undesirable behaviour as your ending up with double the amount of data being transferred if you container consists purely of large objects.
We have been able to circumvent the issue by including .file-segments include the list of download filtered files Preferences → Transfers → Filter.
Fundamentally you want to decouple file segments from the users container, my short term suggestion would be to include .file_segments to the default list of filtered filter.
Longer term I would suggest getting taking the approach of creating .file-segments into its own container, a similar approach to the python swift client.
You could then put some logic in place to calculate the size of the container based on the external file segments container.
Quick note: This was testing on the 4.4.3 Stable build for windows however it may impact other platforms as I presume the logic is shared.
The text was updated successfully, but these errors were encountered:
Added to default regular expression download filter in aafe821. Rewriting our segment feature to store segments in a different container is not currently an option.
It appears that cyberduck is downloading the .file-segments folder along with the unsegmented large files when downloading container in its entirety.
This is extremely undesirable behaviour as your ending up with double the amount of data being transferred if you container consists purely of large objects.
We have been able to circumvent the issue by including .file-segments include the list of download filtered files Preferences → Transfers → Filter.
Fundamentally you want to decouple file segments from the users container, my short term suggestion would be to include .file_segments to the default list of filtered filter.
Longer term I would suggest getting taking the approach of creating .file-segments into its own container, a similar approach to the python swift client.
You could then put some logic in place to calculate the size of the container based on the external file segments container.
Quick note: This was testing on the 4.4.3 Stable build for windows however it may impact other platforms as I presume the logic is shared.
The text was updated successfully, but these errors were encountered: