Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Synchronize does not upload #5154

Closed
cyberduck opened this issue Sep 8, 2010 · 26 comments
Closed

Synchronize does not upload #5154

cyberduck opened this issue Sep 8, 2010 · 26 comments
Assignees
Milestone

Comments

@cyberduck
Copy link
Collaborator

992db4b created the issue

Synchronize no longer functions in build 3.6.1. No files are uploaded to the destination regardless of the timestamps or filesizes on the source directories. Synchronize works with build 3.5.1 on the same set of local and remote directories.

I am using an SFTP connection but don't know if that matters.


Attachments

@cyberduck
Copy link
Collaborator Author

04c97bd commented

Same problem here. Huge folders such as my Mail or Papers folder get "synchronized" nearly imediately (took a long time with older version only to check if there is something to sync). Only a partial synchronization is achieved. For papers e.g. the database of papers gets loaded but all PDFs, stored in separate subfolders) are not synced.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

#5171 closed as duplicate.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

#5187 closed as duplicate.

@cyberduck
Copy link
Collaborator Author

02df168 commented

Here I recognized while synchronizing download that it only builds the folder structure locally , but doesn`t transfer the containing files.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

#5203 closed as duplicate.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

In c539fd8.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

A snapshot build is now available.

@cyberduck
Copy link
Collaborator Author

04c97bd commented

For me the proplem presists with nightly build 7035

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Please test again with the latest build available.

@cyberduck
Copy link
Collaborator Author

04c97bd commented

I tested with build 7124, and I now get data transfer. As far as I can judge from that what arrived in the mail folder, sync worked. The only suspicious thing is that the scanning phase before the transfer was very fast (it took several minutes with version 3.5 ...several GB in the folder).
For the other test folder, I got also transfer, cyberduck reports success (green dot) but on the other hand claims only to have transferred 10% of the data !? (see attached screenshot, first item) . When comparing the size (Command-I) the content o the source!! is less ... but that is perhaps due to different block size. I do not get via Cyberduck the (recursive) number of objects in the folder ... I try to compare tomorrow in situ.

@cyberduck
Copy link
Collaborator Author

04c97bd commented

Finder reports a different number on the both synced machines in the "papers" folder 1904 on the remote an 1894 on the local. Sync does not launch further transfers (now with build 7154), but this was the folder with the problem of Ticket #4093, which no longer appears.

In the mail folder there are on the local machine more files. The scanning time is, more or less the old one, conversely to what I said in the previous mail (today CD wanted to load the whole mail folder, probably I messed with the time stamp settings, and the scanning time recalled me on earlier such incidents).

Summing up: I would say it works as well as with 3.5.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Replying to [comment:13 ye]:

Finder reports a different number on the both synced machines in the "papers" folder 1904 on the remote an 1894 on the local. Sync does not launch further transfers (now with build 7154), but this was the folder with the problem of Ticket #4093, which no longer appears.

In the mail folder there are on the local machine more files. The scanning time is, more or less the old one, conversely to what I said in the previous mail (today CD wanted to load the whole mail folder, probably I messed with the time stamp settings, and the scanning time recalled me on earlier such incidents).

Summing up: I would say it works as well as with 3.5.

I suppose the local folder includes files that are excluded from the transfer such as .DS_Store.

@cyberduck
Copy link
Collaborator Author

04c97bd commented

Replying to [comment:14 dkocher]:

Replying to [comment:13 ye]:

Finder reports a different number on the both synced machines in the "papers" folder 1904 on the remote an 1894 on the local. Sync does not launch further transfers (now with build 7154), but this was the folder with the problem of Ticket #4093, which no longer appears.

In the mail folder there are on the local machine more files. The scanning time is, more or less the old one, conversely to what I said in the previous mail (today CD wanted to load the whole mail folder, probably I messed with the time stamp settings, and the scanning time recalled me on earlier such incidents).

Summing up: I would say it works as well as with 3.5.

I suppose the local folder includes files that are excluded from the transfer such as .DS_Store.

I got the numbers in both caseses on spot with Finder Info (when I was in the office today and with my laptop at home, as I saw no such info available with CD). Also the size is substantially different (the remote papers folder is 5 MB larger than the local the Folder with aprox 2Gb total size) I am not sure that all this results from excluded files.
I can try next week to make a copy on an USB stick and search for the difference in the content.

@cyberduck
Copy link
Collaborator Author

04c97bd commented

Here are the differences of "Papers folder". The version on the desktop is the one from the remote machine. The sync process should download from the remote machine. So at least the pdf-files "Only in /Users/me/Desktop/Papers..." should get synced.

 me$ diff -r /Users/me/Desktop/Papers /Users/me/Documents/Papers 
Binary files /Users/me/Desktop/Papers/.DS_Store and /Users/me/Documents/Papers/.DS_Store differ
Only in /Users/me/Desktop/Papers/1985/Cohen: Cohen-Covering radius--survey and recent results-1985.pdf
Only in /Users/me/Desktop/Papers/1986/McEliece: McEliece-On the decoder error probability for Reed-Solomon codes-1986.pdf
Only in /Users/me/Desktop/Papers/1994/Glynn: Glynn-On the construction of arcs using quadrics-1994.pdf
Only in /Users/me/Desktop/Papers/1997/Cossidente: Cossidente-Applications of line geometry III The quadric Veronesean and the chords of a twisted cubic-1997.pdf
Only in /Users/me/Desktop/Papers/1997/Glynn: Glynn-On cone representations of translation planes-1997.pdf
Only in /Users/me/Desktop/Papers/1998/Glynn: Glynn-A survey of cone representations-1998.pdf
Only in /Users/me/Desktop/Papers/1998/Glynn: Glynn-On cubic curves in projective planes of characteristic two-1998.pdf
Only in /Users/me/Desktop/Papers/1999/Cossidente: Cossidente-Cyclic and elementary abelian caps in projective spaces-1999-1.pdf
Only in /Users/me/Desktop/Papers/1999/Ebert: Ebert-Complete systems of lines on a Hermitian surface over a finite field-1999.pdf
Only in /Users/me/Desktop/Papers/2000: .DS_Store
Only in /Users/me/Documents/Papers/2001/Cooperstein: Cooperstein-On Generalized k-Arcs in PG (2n q)-2001.pdf
Only in /Users/me/Desktop/Papers/2004/Glynn: Glynn-The geometry of additive quantum codes-2004.pdf
Only in /Users/me/Documents/Papers/2005/Unknown: 2005-1.pdf
Only in /Users/me/Documents/Papers/2005/Unknown: 2005-2.pdf
Only in /Users/me/Documents/Papers/2005/Unknown: 2005-3.pdf
Only in /Users/me/Documents/Papers/2005/Unknown: 2005-4.pdf
Only in /Users/me/Documents/Papers/2005/Unknown: 2005-5.pdf
Only in /Users/me/Documents/Papers/2005/Unknown: 2005-6.pdf
Only in /Users/me/Documents/Papers/2005/Unknown: 2005-7.pdf
Only in /Users/me/Documents/Papers/2005/Unknown: 2005-8.pdf
Only in /Users/me/Documents/Papers/2005/Unknown: 2005-9.pdf
Only in /Users/me/Desktop/Papers/2007/Glynn: Glynn-On some quaternary self-orthogonal codes-2007.pdf
Only in /Users/me/Desktop/Papers/2009/Ezerman: Ezerman-The Weights in MDS Codes-2009.pdf
Only in /Users/me/Desktop/Papers/2009/Glynn: Glynn-A geometrical representation theory for orthogonal arrays-2009.pdf
Only in /Users/me/Desktop/Papers/2009/Glynn: Glynn-A note on Nk configurations and theorems in projective space-2009.pdf
Only in /Users/me/Desktop/Papers/2009/Glynn: Glynn-The modular counterparts of Cayley's hyperdeterminants-2009.pdf
Only in /Users/me/Documents/Papers/2009/Nakagawa: Nakagawa-On the number of generalized quadratic APN functions-2009.pdf
Only in /Users/me/Desktop/Papers/2010/Albrecht: Albrecht-Algorithm 898 Efficient multiplication of dense matrices over GF (2)-2010.pdf
Only in /Users/me/Desktop/Papers/2010/Glynn: Glynn-THEOREMS OF POINTS AND PLANES IN THREE-DIMENSIONAL PROJECTIVE SPACE-2010.pdf
Only in /Users/me/Desktop/Papers/2010/Glynn: Glynn-The permanent of a square matrix-2010-1.pdf
Binary files /Users/me/Desktop/Papers/Spotlight/Authors.spotlightIndex and /Users/me/Documents/Papers/Spotlight/Authors.spotlightIndex differ
Binary files /Users/me/Desktop/Papers/Spotlight/Fulltext.spotlightIndex and /Users/me/Documents/Papers/Spotlight/Fulltext.spotlightIndex differ
Binary files /Users/me/Desktop/Papers/Spotlight/General.spotlightIndex and /Users/me/Documents/Papers/Spotlight/General.spotlightIndex differ
Binary files /Users/me/Desktop/Papers/Spotlight/Journals.spotlightIndex and /Users/me/Documents/Papers/Spotlight/Journals.spotlightIndex differ
Binary files /Users/me/Desktop/Papers/Spotlight/Keywords.spotlightIndex and /Users/me/Documents/Papers/Spotlight/Keywords.spotlightIndex differ
Binary files /Users/me/Desktop/Papers/Spotlight/Titles.spotlightIndex and /Users/me/Documents/Papers/Spotlight/Titles.spotlightIndex differ
Only in /Users/me/Documents/Papers/Unknown/Bracken: .DS_Store
Only in /Users/me/Documents/Papers/Unknown: Brewbaker
Only in /Users/me/Desktop/Papers/Unknown/Canteaut: Canteaut-STRUCTURAL WEAKNESSES OF PERMUTATIONS WITH A LOW DIFFERENTIAL UNIFORMITY AND GENERALIZED CROOKED FUNCTIONS.pdf
Only in /Users/me/Desktop/Papers/Unknown/Glynn: Glynn-A condition for arcs and MDS codes.pdf
Only in /Users/me/Desktop/Papers/Unknown/Glynn: Glynn-TRANSFORMATIONS OF CODES AND GEOMETRY RELATED TO VERONESEANS-1.pdf
Only in /Users/me/Desktop/Papers/Unknown/Glynn: Glynn-TRANSFORMATIONS OF CODES AND GEOMETRY RELATED TO VERONESEANS.pdf
Only in /Users/me/Desktop/Papers/Unknown/Unknown: u7366073110168hk.pdf

@cyberduck
Copy link
Collaborator Author

04c97bd commented

I still have the problem with CD3.7 (build 7380), although the change log mentions something fixed with sync.

When syncing my mail folder the scanning process is still nearly immediately finished.
Only the envelope gets transferred but the messages itself are missing.

@cyberduck
Copy link
Collaborator Author

992db4b commented

Replying to [comment:17 ye]:

I still have the problem with CD3.7 (build 7380), although the change log mentions something fixed with sync.

When syncing my mail folder the scanning process is still nearly immediately finished.
Only the envelope gets transferred but the messages itself are missing.

Agreed. I saw the changelog and tried build 7380 but still have the same problem: synchronize does not push local changes to a remote server.

@cyberduck
Copy link
Collaborator Author

04c97bd commented

P.S. with me it is download not upload.

@cyberduck
Copy link
Collaborator Author

aebd672 commented

I have experienced a similar problem and am adding information in case this helps determine the root cause and fix. I was using the current version off the main website or version 3.7. My remote service is Amazon S3. When using Synchronize with "upload", I would get two problems. A compare of large directory (1.6GB) would complete in just a few seconds and it would not upload any newly added files. Drilling down into the directory with an added file(s) and creating a sync on just that directory worked just fine (new file(s) correctly uploaded). This sounds similar to the problem already report. I had a second problem as well. On a completely different folder, each time I asked Cyberduck to sync, it would sync the same 11.MB of files out of the 1GB total size of directory. I did this 4 times and 4 times it uploaded the same files to the remote. It might have something to do with the fact I downloaded these files from the remote to local by accident, and their local timestamp has been updated to the time of download.

Regardless, I reverted to version 3.5.1 and both problems went away.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

#5361 closed as duplicate.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

In 77cdb55 make sure to update timestamp of directory after modifying its content.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Please try the latest snapshot build available.

@cyberduck
Copy link
Collaborator Author

04c97bd commented

I still ( with buit 7825) have the effectthat for my >1GB mail folder the scanning of the folder is imediately finished and nothing happens (sync download).

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Replying to [comment:25 ye]:

I still ( with buit 7825) have the effectthat for my >1GB mail folder the scanning of the folder is imediately finished and nothing happens (sync download).

I think the remaining issue is that directories are not included for the synchronization with the download only option when the local modification date of the folder is newer (but there are possibly still files inside that should be synchronized).

@cyberduck
Copy link
Collaborator Author

@dkocher commented

In 6a4bdbc.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Replying to [comment:21 https://www.google.com/accounts/o8/id?id=aitoawl-cuuwtrnavhgl2a8ldwrox-gbwwnoh5o]:

I have experienced a similar problem and am adding information in case this helps determine the root cause and fix. I was using the current version off the main website or version 3.7. My remote service is Amazon S3. When using Synchronize with "upload", I would get two problems. A compare of large directory (1.6GB) would complete in just a few seconds and it would not upload any newly added files. Drilling down into the directory with an added file(s) and creating a sync on just that directory worked just fine (new file(s) correctly uploaded). This sounds similar to the problem already report. I had a second problem as well. On a completely different folder, each time I asked Cyberduck to sync, it would sync the same 11.MB of files out of the 1GB total size of directory. I did this 4 times and 4 times it uploaded the same files to the remote. It might have something to do with the fact I downloaded these files from the remote to local by accident, and their local timestamp has been updated to the time of download.

Regardless, I reverted to version 3.5.1 and both problems went away.

We now support comparing file checksums for S3, Cloudfiles, Azure and Dropbox protocols making synchronization for these protocols much more robust.

@cyberduck
Copy link
Collaborator Author

04c97bd commented

OK. with build 7852 the scan was completed and seemingly all data was transferred.

Some new bug appeared:
Although I was logged in I got asked for the password (as reason was said "the access to the keychain is disabled by the preferences". This is true I do not store the passwords in the keychain, but I never did before and I only needed to log in once).
Secondly the login window, over the transfer window, immediately appeared again and there was no possibility to make it disappear. The transfer went trough nethertheless.

Also the effect as described in Ticket #4093 is back.

@iterate-ch iterate-ch locked as resolved and limited conversation to collaborators Nov 26, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants