Cyberduck Mountain Duck CLI

#5085 closed defect (worksforme)

Incomplete container listing

Reported by: nathanziarek Owned by: dkocher
Priority: normal Milestone: 3.7
Component: cloudfiles Version: Nightly Build
Severity: normal Keywords: cloudfiles
Cc: Architecture: Intel
Platform: Mac OS X 10.6

Description

When viewing a CloudFiles container with over 15,000 items, only four show in the interface.

Change History (9)

comment:1 Changed on Aug 6, 2010 at 8:06:30 AM by dkocher

This is possibly an issue we have to analyze together with Rackspace support. Can you please post the transcript from the the logging drawer.

comment:2 Changed on Aug 6, 2010 at 12:16:08 PM by nathanziarek

GET /v1.0 HTTP/1.1[\r][\n]
x-auth-user: asq[\r][\n]
x-auth-key: [REMOVED][\r][\n]
User-Agent: Cyberduck/3.5.1 (6117) (Mac OS X/10.6.4) (i386)[\r][\n]
Host: auth.api.rackspacecloud.com[\r][\n]
[\r][\n]
HTTP/1.1 204 No Content[\r][\n]
HTTP/1.1 204 No Content[\r][\n]
Date: Fri, 06 Aug 2010 12:10:51 GMT[\r][\n]
Server: Apache/2.2.3 (Mosso Engineering)[\r][\n]
X-Storage-Url: https://storage5.clouddrive.com/v1/MossoCloudFS_136c3961-7f3c-47fa-b1f5-ff1e49c00827[\r][\n]
X-Storage-Token: 6b019e85-c909-4827-be24-51b7761e4cb5[\r][\n]
X-CDN-Management-Url: https://cdn.clouddrive.com/v1/MossoCloudFS_136c3961-7f3c-47fa-b1f5-ff1e49c00827[\r][\n]
X-Auth-Token: [[HIDE]][\r][\n]
X-Server-Management-Url: https://servers.api.rackspacecloud.com/v1.0/473809[\r][\n]
Content-Length: 0[\r][\n]
Connection: close[\r][\n]
Content-Type: application/octet-stream[\r][\n]
[\r][\n]
GET /v1/MossoCloudFS_136c3961-7f3c-47fa-b1f5-ff1e49c00827?format=xml HTTP/1.1[\r][\n]
X-Auth-Token: [[HIDE]][\r][\n]
User-Agent: Cyberduck/3.5.1 (6117) (Mac OS X/10.6.4) (i386)[\r][\n]
Host: storage5.clouddrive.com[\r][\n]
[\r][\n]
HTTP/1.1 200 OK[\r][\n]
HTTP/1.1 200 OK[\r][\n]
Date: Fri, 06 Aug 2010 12:10:51 GMT[\r][\n]
Server: Apache[\r][\n]
Transfer-Encoding: chunked[\r][\n]
Content-Type: application/xml; charset=utf-8[\r][\n]
[\r][\n]
[\r][\n]
GET /v1/MossoCloudFS_136c3961-7f3c-47fa-b1f5-ff1e49c00827/media?format=xml&limit=10000 HTTP/1.1[\r][\n]
X-Auth-Token: [[HIDE]][\r][\n]
User-Agent: Cyberduck/3.5.1 (6117) (Mac OS X/10.6.4) (i386)[\r][\n]
Host: storage5.clouddrive.com[\r][\n]
[\r][\n]
HTTP/1.1 200 OK[\r][\n]
HTTP/1.1 200 OK[\r][\n]
Date: Fri, 06 Aug 2010 12:11:05 GMT[\r][\n]
Server: Apache[\r][\n]
Transfer-Encoding: chunked[\r][\n]
Content-Type: application/xml; charset=utf-8[\r][\n]
[\r][\n]
[\r][\n]
GET /v1/MossoCloudFS_136c3961-7f3c-47fa-b1f5-ff1e49c00827/media?format=xml&limit=10000&marker=100011%2Fmobile%2F100011_6700717-200k.split.152.ts HTTP/1.1[\r][\n]
X-Auth-Token: [HIDE]][\r][\n]
User-Agent: Cyberduck/3.5.1 (6117) (Mac OS X/10.6.4) (i386)[\r][\n]
Host: storage5.clouddrive.com[\r][\n]
[\r][\n]
HTTP/1.1 200 OK[\r][\n]
HTTP/1.1 200 OK[\r][\n]
Date: Fri, 06 Aug 2010 12:11:10 GMT[\r][\n]
Server: Apache[\r][\n]
Transfer-Encoding: chunked[\r][\n]
Content-Type: application/xml; charset=utf-8[\r][\n]
[\r][\n]
[\r][\n]

I removed the xAuthKey. Hopefully everything else was ok to share (if not, could you please obscure or have me obscure it?).

Process 1) Connect to Rackspace 2) Receive list of containers 3) Open container (with 15,000+ items) 4) Only 4 items listed

Best, Nathan

Last edited on Aug 10, 2010 at 1:28:12 PM by nathanziarek (previous) (diff)

comment:3 Changed on Aug 6, 2010 at 2:41:23 PM by dkocher

Can you try the latest snapshot build (r6578). It lists object without paginating.

comment:4 Changed on Aug 9, 2010 at 12:22:40 PM by nathanziarek

Now I'm getting 0 items...

GET /v1.0 HTTP/1.1
x-auth-user: asq
x-auth-key: [[KEY]]
User-Agent: Cyberduck/3.6 (6578) (Mac OS X/10.6.4) (i386)
Host: auth.api.rackspacecloud.com

HTTP/1.1 204 No Content
HTTP/1.1 204 No Content
Date: Mon, 09 Aug 2010 12:19:15 GMT
Server: Apache/2.2.3 (Mosso Engineering)
X-Storage-Url: https://storage5.clouddrive.com/v1/MossoCloudFS_136c3961-7f3c-47fa-b1f5-ff1e49c00827
X-Storage-Token: 686cca0a-e809-44fb-b3a5-f260cbfe1ec0
X-CDN-Management-Url: https://cdn.clouddrive.com/v1/MossoCloudFS_136c3961-7f3c-47fa-b1f5-ff1e49c00827
X-Auth-Token: 686cca0a-e809-44fb-b3a5-f260cbfe1ec0
X-Server-Management-Url: https://servers.api.rackspacecloud.com/v1.0/473809
Content-Length: 0
Connection: close
Content-Type: application/octet-stream

GET /v1/MossoCloudFS_136c3961-7f3c-47fa-b1f5-ff1e49c00827/media?format=xml HTTP/1.1
X-Auth-Token: 686cca0a-e809-44fb-b3a5-f260cbfe1ec0
User-Agent: Cyberduck/3.6 (6578) (Mac OS X/10.6.4) (i386)
Host: storage5.clouddrive.com

HTTP/1.1 200 OK
HTTP/1.1 200 OK
Date: Mon, 09 Aug 2010 12:19:16 GMT
Server: Apache
Transfer-Encoding: chunked
Content-Type: application/xml; charset=utf-8

comment:5 Changed on Aug 9, 2010 at 12:51:32 PM by dkocher

Please contact Rackspace Support with a reference to this ticket.

comment:6 Changed on Aug 9, 2010 at 12:52:07 PM by dkocher

  • Component changed from core to cloudfiles
  • Summary changed from Rackspace CloudFiles Incomplete Listing to Incomplete container listing

comment:7 follow-up: Changed on Aug 12, 2010 at 1:20:54 AM by nathanziarek

Not sure if a response is needed (or appreciated), but ...

I am using a service called "Encoding.com" to encode files and automatically deliver them to Rackspace CloudFiles. When they deliver them, they are not creating the "folder" objects that are apparently required for the Rackspace API to call them up. Here's the official response from Rackspace:


Somehow those folders you are not seeing were created in such a way that FireUploader (and I guess CyberDuck, etc) were not able to see them -- they were not created as actual folders (content type "application/folder"). I created a folder in the media container called "099904" then created a folder beneath that called "fmobile" -- then all of your objects showed up in that folder in FireUploader. It appears that whatever you used to upload the files didn't create the proper folder structure, so they are not showing up in FireUploader, etc. The files are still serving properly on the CDN however.


I'm working with Encoding.com to hopefully have these entered correctly, but I can verify that with these "folders" created, CyberDuck works like a champ.

Thanks for looking into this an all your hard work.

Best Nathan

Last edited on Aug 12, 2010 at 1:21:35 AM by nathanziarek (previous) (diff)

comment:8 in reply to: ↑ 7 Changed on Aug 12, 2010 at 6:07:24 AM by dkocher

Replying to nathanziarek:

Thanks a lot for your input on this. I don't think it is the same issue here according to the ticket description. Nonetheless, to recognize folder placeholder objects we require the to have a MIME type of application/directory following the recommendation of the CloudFiles Developer Documentation.

comment:9 Changed on Oct 5, 2010 at 11:40:56 AM by dkocher

  • Milestone set to 3.6.2
  • Resolution set to worksforme
  • Status changed from new to closed
Note: See TracTickets for help on using tickets.
swiss made software