Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Incomplete container listing #5085

Closed
cyberduck opened this issue Aug 5, 2010 · 7 comments
Closed

Incomplete container listing #5085

cyberduck opened this issue Aug 5, 2010 · 7 comments
Assignees
@dkocher
Labels
bug cloudfiles Rackspace CloudFiles worksforme
Milestone
3.7

Comments

@cyberduck
Copy link
Collaborator

6771e44 created the issue

When viewing a CloudFiles container with over 15,000 items, only four show in the interface.
@cyberduck
Copy link
Collaborator Author

@dkocher commented

This is possibly an issue we have to analyze together with Rackspace support. Can you please post the transcript from the the logging drawer.

@cyberduck
Copy link
Collaborator Author

6771e44 commented

GET /v1.0 HTTP/1.1[\r][\n]
x-auth-user: asq[\r][\n]
x-auth-key: [REMOVED][\r][\n]
User-Agent: Cyberduck/3.5.1 (6117) (Mac OS X/10.6.4) (i386)[\r][\n]
Host: auth.api.rackspacecloud.com[\r][\n]
[\r][\n]
HTTP/1.1 204 No Content[\r][\n]
HTTP/1.1 204 No Content[\r][\n]
Date: Fri, 06 Aug 2010 12:10:51 GMT[\r][\n]
Server: Apache/2.2.3 (Mosso Engineering)[\r][\n]
X-Storage-Url: https://storage5.clouddrive.com/v1/MossoCloudFS_136c3961-7f3c-47fa-b1f5-ff1e49c00827[\r][\n]
X-Storage-Token: 6b019e85-c909-4827-be24-51b7761e4cb5[\r][\n]
X-CDN-Management-Url: https://cdn.clouddrive.com/v1/MossoCloudFS_136c3961-7f3c-47fa-b1f5-ff1e49c00827[\r][\n]
X-Auth-Token: [[HIDE]][\r][\n]
X-Server-Management-Url: https://servers.api.rackspacecloud.com/v1.0/473809[\r][\n]
Content-Length: 0[\r][\n]
Connection: close[\r][\n]
Content-Type: application/octet-stream[\r][\n]
[\r][\n]
GET /v1/MossoCloudFS_136c3961-7f3c-47fa-b1f5-ff1e49c00827?format=xml HTTP/1.1[\r][\n]
X-Auth-Token: [[HIDE]][\r][\n]
User-Agent: Cyberduck/3.5.1 (6117) (Mac OS X/10.6.4) (i386)[\r][\n]
Host: storage5.clouddrive.com[\r][\n]
[\r][\n]
HTTP/1.1 200 OK[\r][\n]
HTTP/1.1 200 OK[\r][\n]
Date: Fri, 06 Aug 2010 12:10:51 GMT[\r][\n]
Server: Apache[\r][\n]
Transfer-Encoding: chunked[\r][\n]
Content-Type: application/xml; charset=utf-8[\r][\n]
[\r][\n]
[\r][\n]
GET /v1/MossoCloudFS_136c3961-7f3c-47fa-b1f5-ff1e49c00827/media?format=xml&limit=10000 HTTP/1.1[\r][\n]
X-Auth-Token: [[HIDE]][\r][\n]
User-Agent: Cyberduck/3.5.1 (6117) (Mac OS X/10.6.4) (i386)[\r][\n]
Host: storage5.clouddrive.com[\r][\n]
[\r][\n]
HTTP/1.1 200 OK[\r][\n]
HTTP/1.1 200 OK[\r][\n]
Date: Fri, 06 Aug 2010 12:11:05 GMT[\r][\n]
Server: Apache[\r][\n]
Transfer-Encoding: chunked[\r][\n]
Content-Type: application/xml; charset=utf-8[\r][\n]
[\r][\n]
[\r][\n]
GET /v1/MossoCloudFS_136c3961-7f3c-47fa-b1f5-ff1e49c00827/media?format=xml&limit=10000&marker=100011%2Fmobile%2F100011_6700717-200k.split.152.ts HTTP/1.1[\r][\n]
X-Auth-Token: [HIDE]][\r][\n]
User-Agent: Cyberduck/3.5.1 (6117) (Mac OS X/10.6.4) (i386)[\r][\n]
Host: storage5.clouddrive.com[\r][\n]
[\r][\n]
HTTP/1.1 200 OK[\r][\n]
HTTP/1.1 200 OK[\r][\n]
Date: Fri, 06 Aug 2010 12:11:10 GMT[\r][\n]
Server: Apache[\r][\n]
Transfer-Encoding: chunked[\r][\n]
Content-Type: application/xml; charset=utf-8[\r][\n]
[\r][\n]
[\r][\n]

I removed the xAuthKey. Hopefully everything else was ok to share (if not, could you please obscure or have me obscure it?).

Process

  1. Connect to Rackspace
  2. Receive list of containers
  3. Open container (with 15,000+ items)
  4. Only 4 items listed

Best,
Nathan

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Can you try the latest snapshot build (0c54d21). It lists object without paginating.

@cyberduck
Copy link
Collaborator Author

6771e44 commented

Now I'm getting 0 items...

GET /v1.0 HTTP/1.1
x-auth-user: asq
x-auth-key: [[KEY]]
User-Agent: Cyberduck/3.6 (6578) (Mac OS X/10.6.4) (i386)
Host: auth.api.rackspacecloud.com

HTTP/1.1 204 No Content
HTTP/1.1 204 No Content
Date: Mon, 09 Aug 2010 12:19:15 GMT
Server: Apache/2.2.3 (Mosso Engineering)
X-Storage-Url: https://storage5.clouddrive.com/v1/MossoCloudFS_136c3961-7f3c-47fa-b1f5-ff1e49c00827
X-Storage-Token: 686cca0a-e809-44fb-b3a5-f260cbfe1ec0
X-CDN-Management-Url: https://cdn.clouddrive.com/v1/MossoCloudFS_136c3961-7f3c-47fa-b1f5-ff1e49c00827
X-Auth-Token: 686cca0a-e809-44fb-b3a5-f260cbfe1ec0
X-Server-Management-Url: https://servers.api.rackspacecloud.com/v1.0/473809
Content-Length: 0
Connection: close
Content-Type: application/octet-stream

GET /v1/MossoCloudFS_136c3961-7f3c-47fa-b1f5-ff1e49c00827/media?format=xml HTTP/1.1
X-Auth-Token: 686cca0a-e809-44fb-b3a5-f260cbfe1ec0
User-Agent: Cyberduck/3.6 (6578) (Mac OS X/10.6.4) (i386)
Host: storage5.clouddrive.com

HTTP/1.1 200 OK
HTTP/1.1 200 OK
Date: Mon, 09 Aug 2010 12:19:16 GMT
Server: Apache
Transfer-Encoding: chunked
Content-Type: application/xml; charset=utf-8

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Please contact Rackspace Support with a reference to this ticket.

@cyberduck
Copy link
Collaborator Author

6771e44 commented

Not sure if a response is needed (or appreciated), but ...

I am using a service called "Encoding.com" to encode files and automatically deliver them to Rackspace CloudFiles. When they deliver them, they are not creating the "folder" objects that are apparently required for the Rackspace API to call them up. Here's the official response from Rackspace:

Somehow those folders you are not seeing were created in such a way that FireUploader (and I guess CyberDuck, etc) were not able to see them -- they were not created as actual folders (content type "application/folder"). I created a folder in the media container called "099904" then created a folder beneath that called "fmobile" -- then all of your objects showed up in that folder in FireUploader. It appears that whatever you used to upload the files didn't create the proper folder structure, so they are not showing up in FireUploader, etc. The files are still serving properly on the CDN however.

I'm working with Encoding.com to hopefully have these entered correctly, but I can verify that with these "folders" created, CyberDuck works like a champ.

Thanks for looking into this an all your hard work.

Best
Nathan

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Replying to [comment:7 nathanziarek]:

Thanks a lot for your input on this. I don't think it is the same issue here according to the ticket description. Nonetheless, to recognize folder placeholder objects we require the to have a MIME type of application/directory following the recommendation of the CloudFiles Developer Documentation.

@iterate-ch iterate-ch locked as resolved and limited conversation to collaborators Nov 26, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@dkocher dkocher

Labels
bug cloudfiles Rackspace CloudFiles worksforme
Projects
None yet
Milestone
3.7
Development

No branches or pull requests
2 participants
@dkocher @cyberduck