My impression is that there is no such thing as an "empty directory" on S3. 
There really aren't hierarchical folders/directories -- it is a flat namespace. 
Using / as a delimiter gives the illusion of a hierarchy, because you can have

bucket.s3.com/one/two/file.x
bucket.s3.com/one/two/file.y

but there really isn't anything about '/one/two/' that makes it a "directory" 
-- only the fact that there other names that start the same way makes it smell 
like one. You could in fact store data under the names

bucket.s3.com/one
bucket.s3.com/one/two

(unlike in a hierarchical system) as well as the "children" file.x and file.y.

What would / could be stored in s3 to represent an empty directory?

bucket.s3.com/four/

You could store a 0-byte datum with that name, and perhaps s3cmd could work to 
maintain that "a named entry ending / with 0-byte data and no other entries 
that start with the same thing is the s3 equivalent of an empty directory". 
However, I'm not sure that s3 handles names that end with / differently than 
names that are the same without the /. Could you have the entry above and also 
store data in

bucket.s3.com/four

? Only by experimenting could you determine that.


J. Merrill

-----Original Message-----
From: "WagnerOne" <wag...@wagnerone.com>
Sent: Tuesday, March 11, 2014 9:32am
To: S3tools-general@lists.sourceforge.net
Subject: [S3tools-general] empty directories not syncing - known issue

Hi,

I noticed empty directories on my source (not s3) side aren't making it to my 
target, s3 side.

I searched the archives and saw this is a known issue. Is there a timeline for 
when this may be resolved?

Also, what is the current behavior if I create the required empty directories 
in s3 manually and then re-sync with s3cmd --delete-removed? Will those empty 
folders be removed?

I'll do some tests of my own, but thought I'd ask in case you already know.

Thanks,
Mike

-- 
wag...@wagnerone.com
"It is nobler to declare oneself wrong than to insist on being right - 
especially when one is right."-Nietzsche



------------------------------------------------------------------------------
Learn Graph Databases - Download FREE O'Reilly Book
"Graph Databases" is the definitive new guide to graph databases and their
applications. Written by three acclaimed leaders in the field,
this first edition is now available. Download your free book today!
http://p.sf.net/sfu/13534_NeoTech
_______________________________________________
S3tools-general mailing list
S3tools-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/s3tools-general



------------------------------------------------------------------------------
Learn Graph Databases - Download FREE O'Reilly Book
"Graph Databases" is the definitive new guide to graph databases and their
applications. Written by three acclaimed leaders in the field,
this first edition is now available. Download your free book today!
http://p.sf.net/sfu/13534_NeoTech
_______________________________________________
S3tools-general mailing list
S3tools-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/s3tools-general

Reply via email to