Thanks for your thoughts. That is my impression about empty directories or the existence of directories at all in S3 too. I was trying to replicate a hierarchy exactly out of habit. I don't think it's ultimately a requirement for my needs.
Mike On Mar 12, 2014, at 2:26 PM, j.merr...@enlyton.com wrote: > My impression is that there is no such thing as an "empty directory" on S3. > There really aren't hierarchical folders/directories -- it is a flat > namespace. Using / as a delimiter gives the illusion of a hierarchy, because > you can have > > bucket.s3.com/one/two/file.x > bucket.s3.com/one/two/file.y > > but there really isn't anything about '/one/two/' that makes it a "directory" > -- only the fact that there other names that start the same way makes it > smell like one. You could in fact store data under the names > > bucket.s3.com/one > bucket.s3.com/one/two > > (unlike in a hierarchical system) as well as the "children" file.x and file.y. > > What would / could be stored in s3 to represent an empty directory? > > bucket.s3.com/four/ > > You could store a 0-byte datum with that name, and perhaps s3cmd could work > to maintain that "a named entry ending / with 0-byte data and no other > entries that start with the same thing is the s3 equivalent of an empty > directory". However, I'm not sure that s3 handles names that end with / > differently than names that are the same without the /. Could you have the > entry above and also store data in > > bucket.s3.com/four > > ? Only by experimenting could you determine that. > > > J. Merrill > > -----Original Message----- > From: "WagnerOne" <wag...@wagnerone.com> > Sent: Tuesday, March 11, 2014 9:32am > To: S3tools-general@lists.sourceforge.net > Subject: [S3tools-general] empty directories not syncing - known issue > > Hi, > > I noticed empty directories on my source (not s3) side aren't making it to my > target, s3 side. > > I searched the archives and saw this is a known issue. Is there a timeline > for when this may be resolved? > > Also, what is the current behavior if I create the required empty directories > in s3 manually and then re-sync with s3cmd --delete-removed? Will those empty > folders be removed? > > I'll do some tests of my own, but thought I'd ask in case you already know. > > Thanks, > Mike > > -- > wag...@wagnerone.com > "It is nobler to declare oneself wrong than to insist on being right - > especially when one is right."-Nietzsche > > > > ------------------------------------------------------------------------------ > Learn Graph Databases - Download FREE O'Reilly Book > "Graph Databases" is the definitive new guide to graph databases and their > applications. Written by three acclaimed leaders in the field, > this first edition is now available. Download your free book today! > http://p.sf.net/sfu/13534_NeoTech > _______________________________________________ > S3tools-general mailing list > S3tools-general@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/s3tools-general > > > > ------------------------------------------------------------------------------ > Learn Graph Databases - Download FREE O'Reilly Book > "Graph Databases" is the definitive new guide to graph databases and their > applications. Written by three acclaimed leaders in the field, > this first edition is now available. Download your free book today! > http://p.sf.net/sfu/13534_NeoTech > _______________________________________________ > S3tools-general mailing list > S3tools-general@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/s3tools-general -- wag...@wagnerone.com "People say that if you play Microsoft CD's backwards, you hear satanic things, but that's nothing, because if you play them forwards, they install Windows." ------------------------------------------------------------------------------ Learn Graph Databases - Download FREE O'Reilly Book "Graph Databases" is the definitive new guide to graph databases and their applications. Written by three acclaimed leaders in the field, this first edition is now available. Download your free book today! http://p.sf.net/sfu/13534_NeoTech _______________________________________________ S3tools-general mailing list S3tools-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/s3tools-general
