Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Upload log reports "upload complete", but it isn't complete #10801

Closed
cyberduck opened this issue Sep 12, 2019 · 2 comments
Closed

Upload log reports "upload complete", but it isn't complete #10801

cyberduck opened this issue Sep 12, 2019 · 2 comments
Labels
bug cli Command Line Interface worksforme
Milestone
7.9.0

Comments

@cyberduck
Copy link
Collaborator

ef2996d created the issue

Using Cyberduck CLI and GUI v7.02 (30998). Uploaded a file with this command:

duck -P --existing resume --parallel 32    -r --upload wasabisys-us-west-1://T5ZHIOV9VGMNBAKU1HQ4@blaise-backup-west/Magni/Diff/ <local-file>

The log file (attached) contains the following:

20190910-Magni-Daily_20190912014501.nbd…
Resolving s3.us-west-1.wasabisys.com…
Opening S3 connection to s3.us-west-1.wasabisys.com…
S3 connection opened…
Authenticating as T5ZHIOV9VGMNBAKU1HQ4…
Login successful…
Prepare 20190910-Magni-Daily_20190912014501.nbd (Overwrite)…
Prepare 20190910-Magni-Daily_20190912014501.nbd (Overwrite)…
Uploading 20190910-Magni-Daily_20190912014501.nbd…
[▮                             ] 0 B of 6.3 GiB
[▮                             ] 64.0 KiB (65,536 bytes) of 6.3 GiB (0%, 51.6 KB/sec, 36.5 hours remaining)
[▮                             ] 64.0 KiB (65,536 bytes) of 6.3 GiB (0%, 51.6 KB/sec, 36.5 hours remaining)
[▮                             ] 64.0 KiB (65,536 bytes) of 6.3 GiB (0%, 51.5 KB/sec, 36.6 hours remaining)
[▮                             ] 64.0 KiB (65,536 bytes) of 6.3 GiB (0%, 51.4 KB/sec, 36.7 hours remaining)
[▮                             ] 800.0 KiB (819,200 bytes) of 6.3 GiB (0%, 560.7 KB/sec, 3.3 hours remaining)
[▮                             ] 1.6 MiB (1,703,936 bytes) of 6.3 GiB (0%, 1.1 MB/sec, 103 minutes remaining)
[▮                             ] 3.1 MiB (3,276,800 bytes) of 6.3 GiB (0%, 2.0 MB/sec, 57 minutes remaining)
[▮                             ] 5.2 MiB (5,406,720 bytes) of 6.3 GiB (0%, 3.0 MB/sec, 37 minutes remaining)

...

[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,472,171,520 bytes) of 6.3 GiB (95%, 25.2 MB/sec, 13 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,464,176,128 bytes) of 6.3 GiB (95%, 25.1 MB/sec, 14 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,464,208,896 bytes) of 6.3 GiB (95%, 25.1 MB/sec, 14 seconds remaining)
Disconnecting s3.us-west-1.wasabisys.com…
Resolving s3.us-west-1.wasabisys.com…
Opening S3 connection to s3.us-west-1.wasabisys.com…
S3 connection opened…
Authenticating as T5ZHIOV9VGMNBAKU1HQ4…
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,438,322,176 bytes) of 6.3 GiB (94%, 25.0 MB/sec, 15 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,439,010,304 bytes) of 6.3 GiB (94%, 25.0 MB/sec, 15 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,439,862,272 bytes) of 6.3 GiB (94%, 25.0 MB/sec, 15 seconds remaining)
Login successful…
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,440,583,168 bytes) of 6.3 GiB (94%, 25.0 MB/sec, 15 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,433,734,656 bytes) of 6.3 GiB (94%, 25.0 MB/sec, 15 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,434,652,160 bytes) of 6.3 GiB (94%, 24.9 MB/sec, 15 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,435,471,360 bytes) of 6.3 GiB (94%, 24.9 MB/sec, 15 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,436,159,488 bytes) of 6.3 GiB (94%, 24.9 MB/sec, 15 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,436,585,472 bytes) of 6.3 GiB (94%, 24.9 MB/sec, 15 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,437,142,528 bytes) of 6.3 GiB (94%, 24.9 MB/sec, 15 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,437,568,512 bytes) of 6.3 GiB (94%, 24.9 MB/sec, 15 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,438,158,336 bytes) of 6.3 GiB (94%, 24.9 MB/sec, 15 seconds remaining)
Uploading 20190910-Magni-Daily_20190912014501.nbd…
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,438,256,640 bytes) of 6.3 GiB (94%, 24.7 MB/sec, 15 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,438,354,944 bytes) of 6.3 GiB (94%, 24.7 MB/sec, 15 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,438,453,248 bytes) of 6.3 GiB (94%, 24.7 MB/sec, 15 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,439,305,216 bytes) of 6.3 GiB (94%, 24.7 MB/sec, 15 seconds remaining)

...

[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,792,904,704 bytes) of 6.3 GiB (99%, 22.3 MB/sec, 1 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮] 6.3 GiB (6,793,191,681 bytes) of 6.3 GiB (100%, 22.3 MB/sec)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮] 6.3 GiB (6,793,191,681 bytes) of 6.3 GiB (100%, 20.4 MB/sec)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮] 6.3 GiB (6,793,191,681 bytes) of 6.3 GiB (100%, 20.4 MB/sec)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮] 6.3 GiB (6,793,191,681 bytes) of 6.3 GiB (100%, 20.4 MB/sec)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮] 6.3 GiB (6,793,191,681 bytes) of 6.3 GiB (100%, 20.4 MB/sec)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,784,286,720 bytes) of 6.3 GiB (99%, 20.2 MB/sec, 1 seconds remaining)
Disconnecting s3.us-west-1.wasabisys.com…
Transfer incomplete. 20190910-Magni-Daily_20190912014501.nbd…
Disconnecting s3.us-west-1.wasabisys.com…
Resolving s3.us-west-1.wasabisys.com…
Opening S3 connection to s3.us-west-1.wasabisys.com…
S3 connection opened…
Authenticating as T5ZHIOV9VGMNBAKU1HQ4…
Login successful…
Prepare 20190910-Magni-Daily_20190912014501.nbd (Resume)…
Prepare 20190910-Magni-Daily_20190912014501.nbd (Resume)…
Uploading 20190910-Magni-Daily_20190912014501.nbd…
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,784,286,720 bytes) of 6.3 GiB (99%, 0 B/sec)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,784,385,024 bytes) of 6.3 GiB (99%, 224.4 KB/sec, 40 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,784,516,096 bytes) of 6.3 GiB (99%, 382.3 KB/sec, 23 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,785,073,152 bytes) of 6.3 GiB (99%, 1.1 MB/sec, 8 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,785,957,888 bytes) of 6.3 GiB (99%, 2.1 MB/sec, 4 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,787,203,072 bytes) of 6.3 GiB (99%, 3.2 MB/sec, 2 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,789,300,224 bytes) of 6.3 GiB (99%, 5.0 MB/sec, 1 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,791,659,520 bytes) of 6.3 GiB (99%, 6.5 MB/sec, 1 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮] 6.3 GiB (6,793,191,681 bytes) of 6.3 GiB (100%, 7.4 MB/sec)
Upload complete. 20190910-Magni-Daily_20190912014501.nbd…

But the Cyberduck GUI still displays the file both as a "temp" or hidden file (which is displayed during upload), AND as a completed upload, with a size of only 8.5 MiB (the file is > 6 GiB). See attached screen shot.

I have run the command again, thinking it might complete the upload. The log of that upload attempt follows:

20190910-Magni-Daily_20190912014501.nbd…
Resolving s3.us-west-1.wasabisys.com…
Opening S3 connection to s3.us-west-1.wasabisys.com…
S3 connection opened…
Authenticating as T5ZHIOV9VGMNBAKU1HQ4…
Login successful…
Prepare 20190910-Magni-Daily_20190912014501.nbd (Resume)…
Prepare 20190910-Magni-Daily_20190912014501.nbd (Resume)…
Getting permission of 20190910-Magni-Daily_20190912014501.nbd…
Reading metadata of 20190910-Magni-Daily_20190912014501.nbd…
Reading metadata of 20190910-Magni-Daily_20190912014501.nbd…
Uploading 20190910-Magni-Daily_20190912014501.nbd…
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,784,286,720 bytes) of 6.3 GiB (99%, 0 B/sec)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,784,385,024 bytes) of 6.3 GiB (99%, 158.3 KB/sec, 56 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,784,679,936 bytes) of 6.3 GiB (99%, 500.3 KB/sec, 18 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,785,433,600 bytes) of 6.3 GiB (99%, 1.3 MB/sec, 7 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,786,285,568 bytes) of 6.3 GiB (99%, 1.9 MB/sec, 4 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,788,055,040 bytes) of 6.3 GiB (99%, 3.3 MB/sec, 2 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,789,464,064 bytes) of 6.3 GiB (99%, 4.0 MB/sec, 1 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,790,512,640 bytes) of 6.3 GiB (99%, 4.5 MB/sec, 1 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,791,561,216 bytes) of 6.3 GiB (99%, 4.7 MB/sec, 1 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,792,642,560 bytes) of 6.3 GiB (99%, 5.1 MB/sec, 1 seconds remaining)
[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮] 6.3 GiB (6,793,191,681 bytes) of 6.3 GiB (100%, 5.2 MB/sec)
Changing permission of 20190910-Magni-Daily_20190912014501.nbd to {emby (8FB9BB3BC68B38ED3C1A76579156B52CEA5548EACBFCD3312D308CBAA1A19B96)=[FULL_CONTROL]}…
Upload complete. 20190910-Magni-Daily_20190912014501.nbd…

The Cyberduck GUI display (after a refresh) is unchanged.

I have run the command several more times with the same results.

What am I to make of this?

Attachments
@cyberduck
Copy link
Collaborator Author

@dkocher commented

I cannot seem to reproduce this issue running version

mellifera:~ dkocher$ duck -P --existing resume --parallel 32 -r --upload wasabisys-eu-central-1://cyberduck-eu-central-1/ ~/Movies/GOPR0127.MP4 
Upload complete. GOPR0127.MP4…
mellifera:~ dkocher$ echo $?
0

However your transcript shows that the transfer was interrupted and then resumed

[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,784,286,720 bytes) of 6.3 GiB (99%, 20.2 MB/sec, 1 seconds remaining)
4447	Disconnecting s3.us-west-1.wasabisys.com…
4448	Transfer incomplete. 20190910-Magni-Daily_20190912014501.nbd…
4449	Disconnecting s3.us-west-1.wasabisys.com…
4450	Resolving s3.us-west-1.wasabisys.com…
4451	Opening S3 connection to s3.us-west-1.wasabisys.com…
4452	S3 connection opened…
4453	Authenticating as T5ZHIOV9VGMNBAKU1HQ4…
4454	Login successful…
4455	Prepare 20190910-Magni-Daily_20190912014501.nbd (Resume)…
4456	Prepare 20190910-Magni-Daily_20190912014501.nbd (Resume)…
4457	Uploading 20190910-Magni-Daily_20190912014501.nbd…
4458	[▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,784,286,720 bytes) of 6.3 GiB (99%, 0 B/sec)

which might cause this.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Please try with version 7.9.0 which has seen fixes for progress reporting in 084138b and 657ff47.

@iterate-ch iterate-ch locked as resolved and limited conversation to collaborators Nov 26, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
bug cli Command Line Interface worksforme
Projects
None yet
Milestone
7.9.0
Development

No branches or pull requests
1 participant
@cyberduck