Cyberduck Mountain Duck CLI

#10103 assigned defect

User Rate Limit Exceeded error when uploading many files

Reported by: vll_dk Owned by: dkocher
Priority: normal Milestone: 7.0
Component: googledrive Version: 6.2.6
Severity: major Keywords: Google drive; Cryptomator
Cc: densejes@… Architecture: Intel
Platform: Windows 10

Description (last modified by dkocher)

When trying to upload a lot of files (500gb) on/off (testing and trying to find the best solution) I, at some point, got the error 403: User Rate Limit Exceeded when uploading to google drive. I'm uploading to a Cryptomator vault. When I read online the problem could be solved by changing the API settings maybe...

Change History (8)

comment:1 Changed on Oct 7, 2017 at 8:58:43 PM by vll_dk

  • Cc densejes@… added

comment:2 Changed on Oct 8, 2017 at 7:54:06 AM by dkocher

  • Summary changed from Gdrive - 403: User Rate Limit Exceeded to 403: User Rate Limit Exceeded when uploading many files

comment:3 Changed on Oct 8, 2017 at 7:54:49 AM by dkocher

  • Milestone set to 6.3
  • Owner changed from Me to dkocher
  • Status changed from new to assigned

comment:4 Changed on Oct 8, 2017 at 7:55:05 AM by dkocher

Potential improvement in r42695 reducing the number of requests for uploads.

comment:5 Changed on Oct 28, 2017 at 11:07:54 AM by vll_dk

The latest update seems to've mostly fixed the issue for individual file upload (still some issues sometimes) but the error still occurs every time when drag 'n dropping folders with multiple files or simply multiple files at a time in one transfer (not with one file per transfer).

comment:6 Changed on Nov 13, 2017 at 4:24:53 PM by dkocher

  • Milestone changed from 6.3 to 7.0

Ticket retargeted after milestone closed

comment:7 Changed on Jan 13, 2019 at 8:43:20 PM by dkocher

  • Description modified (diff)
  • Summary changed from 403: User Rate Limit Exceeded when uploading many files to User Rate Limit Exceeded error when uploading many files

comment:8 Changed on Jan 13, 2019 at 8:44:12 PM by dkocher

We can reproduce this error in our nightly integration tests.

ch.cyberduck.core.exception.RetriableAccessDeniedException: Cannot create file RVIgMgGk.
	at ch.cyberduck.core.cryptomator.CopyWorkerTest.testCopyDirectoryIntoVault(CopyWorkerTest.java:214)
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 
403 Forbidden
{
  "code": 403,
  "errors": [
    {
      "domain": "usageLimits",
      "message": "User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordingly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=996125414232",
      "reason": "userRateLimitExceeded",
      "extendedHelp": "https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=996125414232"
    }
  ],
  "message": "User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordingly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=996125414232"
}
	at ch.cyberduck.core.cryptomator.CopyWorkerTest.testCopyDirectoryIntoVault(CopyWorkerTest.java:214)

Note: See TracTickets for help on using tickets.
swiss made software