Rackspace CloudFiles 10000 Container/Folder Limit in Cyberduck

[samsen]

There are repeated messages, saying that this has been fixed, but it appears that this is not the case.

• r8247
• #5664
• r5582
• #3950

We continue to see only 10,000 containers when we have over 12,000 containers in our CloudFiles Account.

We are running Cyberduck 4.02 8601

And we might be able to live with this if searches extended beyond the 10,000 containers, but it appears that the searches only take place within the first 10,000 containers found...

[samsen]

The system will return a [maximum] of 10,000 container names per request. To retrieve subsequent container names, another request must be made with a 'marker' parameter. The marker indicates where the last list left off; the system will return container names greater than this marker, up to 10,000 again. Note that the ‘marker’ value should be URLencoded prior to sending the HTTP request.

If 10,000 is larger than desired, a 'limit' parameter may be given.

If the number of container names returned equals the limit given (or 10,000 if no limit is given), it can be assumed there are more container names to be listed. If the container name list is exactly divisible by the limit, the last request will simply have no content.

Example 4.8. List Large Number of Containers

For example, let's use a listing of five container names apples bananas kiwis oranges pears

We'll use a limit of two to show how things work: GET ?limit=2 Host: storage.clouddrive.com X-Auth-Token: eaaafd18-0fed-4b3a-81b4-663c99ec1cbbCloud Files™ Developer Guide May 24, 2011 API v1 14 apples bananas

Since we received two items back, we can assume there are more container names to list, so we make another request with a marker of the last item returned: GET ?limit=2&marker=bananas Host: storage.clouddrive.com X-Auth-Token: eaaafd18-0fed-4b3a-81b4-663c99ec1cbb

kiwis oranges Again, two items are returned; there may be more: GET ?limit=2&marker=oranges Host: storage.clouddrive.com X-Auth-Token: eaaafd18-0fed-4b3a-81b4-663c99ec1cbb pears

With this one-item response we received less than the limit number of container names, indicating that this is the end of the list

[dkocher]

The previous tickets talked about the listing of files within containers.

[dkocher]

In r8836.

[samsen]

Yes, I was fixated on the 10,000 number that must apply to both containers AND the content of containers, so that I didn't distinguish them. So thank-you for fixing the issue.