FYI, just stumbled upon this bug reported in Debian bugtracker.

--- Begin Message ---
Package: s3cmd
Version: 0.9.9.91-1
Severity: normal


Hi

It appears that "s3cmd sync" command will not perform md5 checks and will 
always re-download all files when the remote source is the root directory of 
the bucket and local destination path doesn't have a trailing slash.

For example, I have a S3 bucket and a local directory, both containing the same 
file with the same content:

$ ls -l data
total 4
-rw-r--r-- 1 avian avian 512 jan  8 14:54 foo

$ s3cmd ls s3://data111
2011-01-08 13:55       512   s3://data111/foo

The following 4 sync commands all have the same effect, except that in the 
first 2 cases s3cmd will always redownload the file, even when it is identical 
at both ends:

$ s3cmd sync s3://data111/ data
s3://data111/foo -> data/foo  [1 of 1]
 512 of 512   100% in    0s  1499.68 B/s  done
Done. Downloaded 512 bytes in 0.3 seconds, 1497.26 B/s

$ s3cmd sync s3://data111 data
s3://data111/foo -> data/foo  [1 of 1]
 512 of 512   100% in    0s  1880.70 B/s  done
Done. Downloaded 512 bytes in 0.3 seconds, 1874.49 B/s

$ s3cmd sync s3://data111/ data/

$ s3cmd sync s3://data111 data/

Best regards
Tomaž

-- System Information:
Debian Release: squeeze/sid
  APT prefers testing
  APT policy: (500, 'testing')
Architecture: amd64 (x86_64)

Kernel: Linux 2.6.34.7 (SMP w/4 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash

Versions of packages s3cmd depends on:
ii  python                  2.6.6-3+squeeze4 interactive high-level object-orie
ii  python-support          1.0.10           automated rebuilding support for P

s3cmd recommends no packages.

s3cmd suggests no packages.

-- no debconf information



--- End Message ---
-- 

Attachment: pgp8apD6Noxte.pgp
Description: PGP signature

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
S3tools-general mailing list
S3tools-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/s3tools-general

Reply via email to