Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Consumes huge amounts of memory when downloading a large online-only vault #11051

Closed
cyberduck opened this issue May 11, 2020 · 8 comments
Closed

Consumes huge amounts of memory when downloading a large online-only vault #11051

cyberduck opened this issue May 11, 2020 · 8 comments
Assignees
@dkocher
Labels
bug duplicate high priority onedrive OneDrive Protocol Implementation
Milestone
7.7.0

Comments

@cyberduck
Copy link
Collaborator

ce6d08c created the issue

Hi,

there's a serious issue in Cyberduck that keeps one from downloading large contents from an online-only OneDrive vault (maybe others, too).

I've tried to download 50 GB of data. It started downloading but after approx 2 hours the system got sluggish and reported that there's not enough memory.

When the download starts then Cyberduck's memory usages rises and rises. You can easily see that in terminal using "top" as command.

It seems that buffers are not cleared properly.

Please analyze and fix this accordingly.

Thanks and best regards,
rootie
@cyberduck
Copy link
Collaborator Author

@dkocher commented

Please double check you are running version 7.3.1 which contains a memory usage fix.

@cyberduck
Copy link
Collaborator Author

ce6d08c commented

Hi,

I've double checked and I can confirm that the issue is still there with 7.3.1. Maybe the memory usage fix even introduced the issue!

@cyberduck
Copy link
Collaborator Author

ce6d08c commented

Hi again,

I've downloaded the previous version Cyberduck 7.3.0.32621 and can confirm that it WORKS there. Hence this must have been introduced with 7.3.1.

I'm quite sure that this memory fix does not work properly. With the old version the RAM memory usage stays < 500 MB during the whole download and does not increase permanently. It seems that every MB that Cyberduck is downloading with 7.3.1 is added to the RAM usage.

@cyberduck
Copy link
Collaborator Author

ce6d08c commented

Small update: The RAM usage DOES increase with CyberDuck 7.3.0.32621 but not close as much as with 7.3.1. After downloading 17.5 GB from the online-only vault (OneDrive) CyberDuck 7.3.0.32621 consumes about 2,5 GB of RAM.

With 7.3.1 it would have consumed 17.5 GB.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

If possible please follow the instructions in [#11049#comment:4]

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Milestone renamed

2 similar comments
@cyberduck
Copy link
Collaborator Author

@dkocher commented

Milestone renamed

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Milestone renamed

@iterate-ch iterate-ch locked as resolved and limited conversation to collaborators Nov 27, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@dkocher dkocher

Labels
bug duplicate high priority onedrive OneDrive Protocol Implementation
Projects
None yet
Milestone
7.7.0
Development

No branches or pull requests
2 participants
@dkocher @cyberduck