[S3tools-general] Not deleting on sync, empty object message

Russell Gadd Tue, 05 May 2015 04:19:40 -0700

I'm getting some of these messages, which I don't see a cause for (see
below but there are other instances when I get this message)
WARNING: Empty object name on S3 found, ignoring.


Also when I did a sync of a folder it said it was deleting a remote file
but the file remains in s3. This is the output:

$ s3cmd -v sync . ${BUCKET}/software/
INFO: Compiling list of local files...
INFO: Running stat() and reading/calculating MD5 values on 9 files, this
may take some time...
INFO: Retrieving list of remote files for s3://mybucket/software/ ...
INFO: Forwarding request to eu-west-1
WARNING: Empty object name on S3 found, ignoring.
INFO: Found 9 local files, 10 remote files
INFO: Verifying attributes...
INFO: Summary: 0 local files to upload, 0 files to remote copy, 1 remote
files to delete
INFO: Done. Uploaded 0 bytes in 1.0 seconds, 0.00 B/s. Copied 0 files
saving 0 bytes transfer.

Also attached sanitised debug output if it is useful

s3cmd version 1.5.2


Russell

/data/WorkInProgressSSD/s3dev/rs3BackupSystem/software $ ./rs3-uploadsoftware 
DEBUG: ConfigParser: Reading file '/home/jr/.s3cfg'
DEBUG: ConfigParser: access_key->AK...17_chars...Q
DEBUG: ConfigParser: access_token->
DEBUG: ConfigParser: add_encoding_exts->
DEBUG: ConfigParser: add_headers->
DEBUG: ConfigParser: bucket_location->eu-west
DEBUG: ConfigParser: ca_certs_file->
DEBUG: ConfigParser: cache_file->
DEBUG: ConfigParser: check_ssl_certificate->True
DEBUG: ConfigParser: cloudfront_host->cloudfront.amazonaws.com
DEBUG: ConfigParser: default_mime_type->binary/octet-stream
DEBUG: ConfigParser: delay_updates->False
DEBUG: ConfigParser: delete_after->False
DEBUG: ConfigParser: delete_after_fetch->False
DEBUG: ConfigParser: delete_removed->False
DEBUG: ConfigParser: dry_run->False
DEBUG: ConfigParser: enable_multipart->True
DEBUG: ConfigParser: encoding->UTF-8
DEBUG: ConfigParser: encrypt->False
DEBUG: ConfigParser: expiry_date->
DEBUG: ConfigParser: expiry_days->
DEBUG: ConfigParser: expiry_prefix->
DEBUG: ConfigParser: follow_symlinks->False
DEBUG: ConfigParser: force->False
DEBUG: ConfigParser: get_continue->False
DEBUG: ConfigParser: gpg_command->/usr/bin/gpg
DEBUG: ConfigParser: gpg_decrypt->%(gpg_command)s -d --verbose --no-use-agent 
--batch --yes --passphrase-fd %(passphrase_fd)s -o %(output_file)s 
%(input_file)s
DEBUG: ConfigParser: gpg_encrypt->%(gpg_command)s -c --verbose --no-use-agent 
--batch --yes --passphrase-fd %(passphrase_fd)s -o %(output_file)s 
%(input_file)s
DEBUG: ConfigParser: gpg_passphrase->x8...17_chars...7
DEBUG: ConfigParser: guess_mime_type->True
DEBUG: ConfigParser: host_base->s3.amazonaws.com
DEBUG: ConfigParser: host_bucket->%(bucket)s.s3.amazonaws.com
DEBUG: ConfigParser: human_readable_sizes->False
DEBUG: ConfigParser: ignore_failed_copy->False
DEBUG: ConfigParser: invalidate_default_index_on_cf->False
DEBUG: ConfigParser: invalidate_default_index_root_on_cf->True
DEBUG: ConfigParser: invalidate_on_cf->False
DEBUG: ConfigParser: list_md5->False
DEBUG: ConfigParser: log_target_prefix->
DEBUG: ConfigParser: max_delete->-1
DEBUG: ConfigParser: mime_type->
DEBUG: ConfigParser: multipart_chunk_size_mb->15
DEBUG: ConfigParser: preserve_attrs->True
DEBUG: ConfigParser: progress_meter->True
DEBUG: ConfigParser: proxy_host->
DEBUG: ConfigParser: proxy_port->0
DEBUG: ConfigParser: put_continue->False
DEBUG: ConfigParser: recursive->False
DEBUG: ConfigParser: recv_chunk->4096
DEBUG: ConfigParser: reduced_redundancy->False
DEBUG: ConfigParser: restore_days->1
DEBUG: ConfigParser: secret_key->tg...37_chars...v
DEBUG: ConfigParser: send_chunk->4096
DEBUG: ConfigParser: server_side_encryption->False
DEBUG: ConfigParser: signature_v2->False
DEBUG: ConfigParser: simpledb_host->sdb.amazonaws.com
DEBUG: ConfigParser: skip_existing->False
DEBUG: ConfigParser: socket_timeout->300
DEBUG: ConfigParser: urlencoding_mode->normal
DEBUG: ConfigParser: use_https->True
DEBUG: ConfigParser: use_mime_magic->True
DEBUG: ConfigParser: verbosity->WARNING
DEBUG: ConfigParser: 
website_endpoint->http://%(bucket)s.s3-website-%(location)s.amazonaws.com/
DEBUG: ConfigParser: website_error->
DEBUG: ConfigParser: website_index->index.html
DEBUG: Updating Config.Config cache_file -> 
DEBUG: Updating Config.Config follow_symlinks -> False
DEBUG: Updating Config.Config verbosity -> 10
DEBUG: Unicodising 'sync' using UTF-8
DEBUG: Unicodising '.' using UTF-8
DEBUG: Unicodising 's3://mybucket/software/' using UTF-8
DEBUG: Command: sync
INFO: Compiling list of local files...
DEBUG: DeUnicodising u'.' using UTF-8
DEBUG: DeUnicodising u'.' using UTF-8
DEBUG: DeUnicodising u'.' using UTF-8
DEBUG: Unicodising './rs3-auditindex' using UTF-8
DEBUG: Unicodising './rs3-auditindex' using UTF-8
DEBUG: Unicodising './rs3-awsclifns' using UTF-8
DEBUG: Unicodising './rs3-awsclifns' using UTF-8
DEBUG: Unicodising './rs3-declares' using UTF-8
DEBUG: Unicodising './rs3-declares' using UTF-8
DEBUG: Unicodising './rs3-functions' using UTF-8
DEBUG: Unicodising './rs3-functions' using UTF-8
DEBUG: Unicodising './rs3-s3toolsfns' using UTF-8
DEBUG: Unicodising './rs3-s3toolsfns' using UTF-8
DEBUG: Unicodising './rs3-setup' using UTF-8
DEBUG: Unicodising './rs3-setup' using UTF-8
DEBUG: Unicodising './rs3-testexclusions' using UTF-8
DEBUG: Unicodising './rs3-testexclusions' using UTF-8
DEBUG: Unicodising './rs3-uploadsoftware' using UTF-8
DEBUG: Unicodising './rs3-uploadsoftware' using UTF-8
DEBUG: Unicodising './rs3-uploadsoftware~' using UTF-8
DEBUG: Unicodising './rs3-uploadsoftware~' using UTF-8
DEBUG: Unicodising './rs3bu' using UTF-8
DEBUG: Unicodising './rs3bu' using UTF-8
DEBUG: Applying --exclude/--include
DEBUG: CHECK: rs3-auditindex
DEBUG: PASS: u'rs3-auditindex'
DEBUG: CHECK: rs3-awsclifns
DEBUG: PASS: u'rs3-awsclifns'
DEBUG: CHECK: rs3-declares
DEBUG: PASS: u'rs3-declares'
DEBUG: CHECK: rs3-functions
DEBUG: PASS: u'rs3-functions'
DEBUG: CHECK: rs3-s3toolsfns
DEBUG: PASS: u'rs3-s3toolsfns'
DEBUG: CHECK: rs3-setup
DEBUG: PASS: u'rs3-setup'
DEBUG: CHECK: rs3-testexclusions
DEBUG: PASS: u'rs3-testexclusions'
DEBUG: CHECK: rs3-uploadsoftware
DEBUG: PASS: u'rs3-uploadsoftware'
DEBUG: CHECK: rs3-uploadsoftware~
DEBUG: PASS: u'rs3-uploadsoftware~'
DEBUG: CHECK: rs3bu
DEBUG: PASS: u'rs3bu'
INFO: Running stat() and reading/calculating MD5 values on 10 files, this may 
take some time...
DEBUG: doing file I/O to read md5 of rs3-auditindex
DEBUG: doing file I/O to read md5 of rs3-awsclifns
DEBUG: doing file I/O to read md5 of rs3-declares
DEBUG: doing file I/O to read md5 of rs3-functions
DEBUG: doing file I/O to read md5 of rs3-s3toolsfns
DEBUG: doing file I/O to read md5 of rs3-setup
DEBUG: doing file I/O to read md5 of rs3-testexclusions
DEBUG: doing file I/O to read md5 of rs3-uploadsoftware
DEBUG: doing file I/O to read md5 of rs3-uploadsoftware~
DEBUG: doing file I/O to read md5 of rs3bu
DEBUG: Unicodising 'software/' using UTF-8
DEBUG: Unicodising 'software/' using UTF-8
INFO: Retrieving list of remote files for s3://mybucket/software/ ...
DEBUG: String 'software/' encoded to 'software/'
DEBUG: CreateRequest: resource[uri]=/
DEBUG: Using signature v4
DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com
DEBUG: canonical_headers = host:mybucket.s3.amazonaws.com
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20150505T110044Z

DEBUG: Canonical Request:
GET
/
prefix=software%2F
host:mybucket.s3.amazonaws.com
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20150505T110044Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
----------------------
DEBUG: signature-v4 headers: {'x-amz-content-sha256': 
'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 
'Authorization': 'AWS4-HMAC-SHA256 
Credential=XXXXXXXXXXXXXXXXXXXXX/20150505/eu-west/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-date,Signature=228a87cbe97d709652338088a8ff0f4d5ac3f495115094c6883f870c67951a7b',
 'x-amz-date': '20150505T110044Z'}
DEBUG: Processing request, please wait...
DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com
DEBUG: ConnMan.get(): creating new connection: https://mybucket.s3.amazonaws.com
DEBUG: Using ca_certs_file None
DEBUG: non-proxied HTTPSConnection(mybucket.s3.amazonaws.com)
DEBUG: format_uri(): /?prefix=software/
DEBUG: Sending request method_string='GET', uri='/?prefix=software/', 
headers={'x-amz-content-sha256': 
'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 
'Authorization': 'AWS4-HMAC-SHA256 
Credential=XXXXXXXXXXXXXXXXXXXXX/20150505/eu-west/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-date,Signature=228a87cbe97d709652338088a8ff0f4d5ac3f495115094c6883f870c67951a7b',
 'x-amz-date': '20150505T110044Z'}, body=(0 bytes)
DEBUG: Response: {'status': 400, 'headers': {'x-amz-id-2': 
't3kvjHQLLUeWNeQx4ljrMZzKSu6KuP740DBryU07nqij8Pq/HFIeD3SltYN7s2lcx5+Fyd/wPgA=', 
'server': 'AmazonS3', 'transfer-encoding': 'chunked', 'connection': 'close', 
'x-amz-request-id': 'D93B544A8D6703D3', 'date': 'Tue, 05 May 2015 11:00:45 
GMT', 'content-type': 'application/xml'}, 'reason': 'Bad Request', 'data': 
'<?xml version="1.0" 
encoding="UTF-8"?>\n<Error><Code>AuthorizationHeaderMalformed</Code><Message>The
 authorization header is malformed; the region \'eu-west\' is wrong; expecting 
\'eu-west-1\'</Message><Region>eu-west-1</Region><RequestId>D93B544A8D6703D3</RequestId><HostId>t3kvjHQLLUeWNeQx4ljrMZzKSu6KuP740DBryU07nqij8Pq/HFIeD3SltYN7s2lcx5+Fyd/wPgA=</HostId></Error>'}
DEBUG: ConnMan.put(): connection put back to pool 
(https://mybucket.s3.amazonaws.com#1)
INFO: Forwarding request to eu-west-1
DEBUG: Using signature v4
DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com
DEBUG: canonical_headers = host:mybucket.s3.amazonaws.com
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20150505T110045Z

DEBUG: Canonical Request:
GET
/
prefix=software%2F
host:mybucket.s3.amazonaws.com
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20150505T110045Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
----------------------
DEBUG: signature-v4 headers: {'x-amz-content-sha256': 
'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 
'x-amz-date': '20150505T110045Z', 'Authorization': 'AWS4-HMAC-SHA256 
Credential=XXXXXXXXXXXXXXXXXXXXX/20150505/eu-west-1/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-date,Signature=bc8c2ef18893dfb5b2b24a196fc7cf2eea3e3b783fc165c85c2a38c588086921'}
DEBUG: Processing request, please wait...
DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com
DEBUG: ConnMan.get(): re-using connection: https://mybucket.s3.amazonaws.com#1
DEBUG: format_uri(): /?prefix=software/
DEBUG: Sending request method_string='GET', uri='/?prefix=software/', 
headers={'x-amz-content-sha256': 
'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 
'x-amz-date': '20150505T110045Z', 'Authorization': 'AWS4-HMAC-SHA256 
Credential=XXXXXXXXXXXXXXXXXXXXX/20150505/eu-west-1/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-date,Signature=bc8c2ef18893dfb5b2b24a196fc7cf2eea3e3b783fc165c85c2a38c588086921'},
 body=(0 bytes)
DEBUG: Response: {'status': 200, 'headers': {'x-amz-id-2': 
'lfupRlqL/RZBU8Gwbuqdhr2DDZRp5hRgHBkkTueQ+UgEBxe7XudYwaNyEHjCI9JTpwZG9SZ8XZE=', 
'server': 'AmazonS3', 'transfer-encoding': 'chunked', 'x-amz-request-id': 
'E0636ACC0242FFA0', 'date': 'Tue, 05 May 2015 11:00:46 GMT', 'content-type': 
'application/xml'}, 'reason': 'OK', 'data': '<?xml version="1.0" 
encoding="UTF-8"?>\n<ListBucketResult 
xmlns="http://s3.amazonaws.com/doc/2006-03-01/";><Name>mybucket</Name><Prefix>software/</Prefix><Marker></Marker><MaxKeys>1000</MaxKeys><IsTruncated>false</IsTruncated><Contents><Key>software/</Key><LastModified>2015-05-05T10:29:06.000Z</LastModified><ETag>&quot;d41d8cd98f00b204e9800998ecf8427e&quot;</ETag><Size>0</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>software/rs3-auditindex</Key><LastModified>2015-05-05T10:55:00.000Z</LastModified><ETag>&quot;c79d9a4cee48564bc557dddbc321fd83&quot;</ETag><Size>738</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>software/rs3-awsclifns</Key><LastModified>2015-05-05T10:55:00.000Z</LastModified><ETag>&quot;f0580516e1feffd209444d7bd25ec75e&quot;</ETag><Size>4192</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>software/rs3-declares</Key><LastModified>2015-05-05T10:55:00.000Z</LastModified><ETag>&quot;e98d1db7ebe6710e71cbbf9d4502e995&quot;</ETag><Size>5887</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>software/rs3-functions</Key><LastModified>2015-05-05T10:55:00.000Z</LastModified><ETag>&quot;1e301a27a56bff34da962c8ad1aa45d6&quot;</ETag><Size>21991</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>software/rs3-s3toolsfns</Key><LastModified>2015-05-05T10:55:01.000Z</LastModified><ETag>&quot;122b413e9a8a932ccc705e5410211888&quot;</ETag><Size>4486</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>software/rs3-setup</Key><LastModified>2015-05-05T10:55:01.000Z</LastModified><ETag>&quot;2fb5e38d771c217eee7981f608dd87aa&quot;</ETag><Size>904</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>software/rs3-testexclusions</Key><LastModified>2015-05-05T10:55:01.000Z</LastModified><ETag>&quot;08744d0923ece872aee9463b623e1e97&quot;</ETag><Size>404</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>software/rs3-uploadsoftware</Key><LastModified>2015-05-05T10:55:01.000Z</LastModified><ETag>&quot;dd547c81228c8dfeafa014dc1dfd025f&quot;</ETag><Size>380</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>software/rs3-uploadsoftware~</Key><LastModified>2015-05-05T10:55:01.000Z</LastModified><ETag>&quot;a393c628a452038a16a2d4584a40ded0&quot;</ETag><Size>390</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>software/rs3bu</Key><LastModified>2015-05-05T10:55:01.000Z</LastModified><ETag>&quot;2ce39b2f4b2f448d93db61d654910999&quot;</ETag><Size>6179</Size><Owner><ID>fefbad8f3575c8456bece90907230a889def45c7085a8d433d4bf41fd2183e0e</ID><DisplayName>myid</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents></ListBucketResult>'}
DEBUG: ConnMan.put(): connection put back to pool 
(https://mybucket.s3.amazonaws.com#2)
WARNING: Empty object name on S3 found, ignoring.
DEBUG: Applying --exclude/--include
DEBUG: CHECK: rs3-auditindex
DEBUG: PASS: 'rs3-auditindex'
DEBUG: CHECK: rs3-awsclifns
DEBUG: PASS: 'rs3-awsclifns'
DEBUG: CHECK: rs3-declares
DEBUG: PASS: 'rs3-declares'
DEBUG: CHECK: rs3-functions
DEBUG: PASS: 'rs3-functions'
DEBUG: CHECK: rs3-s3toolsfns
DEBUG: PASS: 'rs3-s3toolsfns'
DEBUG: CHECK: rs3-setup
DEBUG: PASS: 'rs3-setup'
DEBUG: CHECK: rs3-testexclusions
DEBUG: PASS: 'rs3-testexclusions'
DEBUG: CHECK: rs3-uploadsoftware
DEBUG: PASS: 'rs3-uploadsoftware'
DEBUG: CHECK: rs3-uploadsoftware~
DEBUG: PASS: 'rs3-uploadsoftware~'
DEBUG: CHECK: rs3bu
DEBUG: PASS: 'rs3bu'
INFO: Found 10 local files, 10 remote files
INFO: Verifying attributes...
DEBUG: Comparing filelists (direction: local -> remote)
DEBUG: CHECK: rs3-auditindex
DEBUG: IGNR: rs3-auditindex (transfer not needed)
DEBUG: CHECK: rs3-awsclifns
DEBUG: IGNR: rs3-awsclifns (transfer not needed)
DEBUG: CHECK: rs3-declares
DEBUG: IGNR: rs3-declares (transfer not needed)
DEBUG: CHECK: rs3-functions
DEBUG: IGNR: rs3-functions (transfer not needed)
DEBUG: CHECK: rs3-s3toolsfns
DEBUG: IGNR: rs3-s3toolsfns (transfer not needed)
DEBUG: CHECK: rs3-setup
DEBUG: IGNR: rs3-setup (transfer not needed)
DEBUG: CHECK: rs3-testexclusions
DEBUG: IGNR: rs3-testexclusions (transfer not needed)
DEBUG: CHECK: rs3-uploadsoftware
DEBUG: xfer: rs3-uploadsoftware (size mismatch: src=385 dst=380)
DEBUG: CHECK: rs3-uploadsoftware~
DEBUG: xfer: rs3-uploadsoftware~ (size mismatch: src=380 dst=390)
DEBUG: DST COPY src: rs3-uploadsoftware -> rs3-uploadsoftware~
DEBUG: CHECK: rs3bu
DEBUG: IGNR: rs3bu (transfer not needed)
INFO: Summary: 1 local files to upload, 1 files to remote copy, 0 remote files 
to delete
DEBUG: attr_header: {'x-amz-meta-s3cmd-attrs': 
'uid:1000/gname:jr/uname:jr/gid:1000/mode:33279/mtime:1430823637/atime:1430823637/md5:b5618e68f5e33ef69eb77010c8627ab2/ctime:1430823637'}
DEBUG: String 'software/rs3-uploadsoftware' encoded to 
'software/rs3-uploadsoftware'
DEBUG: CreateRequest: resource[uri]=/software/rs3-uploadsoftware
DEBUG: Unicodising './rs3-uploadsoftware' using UTF-8
DEBUG: Using signature v4
DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com
DEBUG: canonical_headers = content-length:385
content-type:text/x-shellscript
host:mybucket.s3.amazonaws.com
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20150505T110045Z
x-amz-meta-s3cmd-attrs:uid:1000/gname:jr/uname:jr/gid:1000/mode:33279/mtime:1430823637/atime:1430823637/md5:b5618e68f5e33ef69eb77010c8627ab2/ctime:1430823637

DEBUG: Canonical Request:
PUT
/software/rs3-uploadsoftware

content-length:385
content-type:text/x-shellscript
host:mybucket.s3.amazonaws.com
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20150505T110045Z
x-amz-meta-s3cmd-attrs:uid:1000/gname:jr/uname:jr/gid:1000/mode:33279/mtime:1430823637/atime:1430823637/md5:b5618e68f5e33ef69eb77010c8627ab2/ctime:1430823637

content-length;content-type;host;x-amz-content-sha256;x-amz-date;x-amz-meta-s3cmd-attrs
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
----------------------
DEBUG: signature-v4 headers: {'x-amz-content-sha256': 
'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 
'content-length': 385, 'x-amz-meta-s3cmd-attrs': 
'uid:1000/gname:jr/uname:jr/gid:1000/mode:33279/mtime:1430823637/atime:1430823637/md5:b5618e68f5e33ef69eb77010c8627ab2/ctime:1430823637',
 'x-amz-date': '20150505T110045Z', 'content-type': 'text/x-shellscript', 
'Authorization': 'AWS4-HMAC-SHA256 
Credential=XXXXXXXXXXXXXXXXXXXXX/20150505/eu-west-1/s3/aws4_request,SignedHeaders=content-length;content-type;host;x-amz-content-sha256;x-amz-date;x-amz-meta-s3cmd-attrs,Signature=b0fc99e15f10bbe6b3036ddc6103a4768bf71f800a89f795d8994d67d7fb2582'}
./rs3-uploadsoftware -> s3://mybucket/software/rs3-uploadsoftware  [1 of 1]
DEBUG: Using signature v4
DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com
DEBUG: canonical_headers = content-length:385
content-type:text/x-shellscript
host:mybucket.s3.amazonaws.com
x-amz-content-sha256:baaafe98ff33f7c51999d5bdb166b27ee613c0667df07485fb3f3a39ffd5f55e
x-amz-date:20150505T110045Z
x-amz-meta-s3cmd-attrs:uid:1000/gname:jr/uname:jr/gid:1000/mode:33279/mtime:1430823637/atime:1430823637/md5:b5618e68f5e33ef69eb77010c8627ab2/ctime:1430823637

DEBUG: Canonical Request:
PUT
/software/rs3-uploadsoftware

content-length:385
content-type:text/x-shellscript
host:mybucket.s3.amazonaws.com
x-amz-content-sha256:baaafe98ff33f7c51999d5bdb166b27ee613c0667df07485fb3f3a39ffd5f55e
x-amz-date:20150505T110045Z
x-amz-meta-s3cmd-attrs:uid:1000/gname:jr/uname:jr/gid:1000/mode:33279/mtime:1430823637/atime:1430823637/md5:b5618e68f5e33ef69eb77010c8627ab2/ctime:1430823637

content-length;content-type;host;x-amz-content-sha256;x-amz-date;x-amz-meta-s3cmd-attrs
baaafe98ff33f7c51999d5bdb166b27ee613c0667df07485fb3f3a39ffd5f55e
----------------------
DEBUG: signature-v4 headers: {'x-amz-content-sha256': 
'baaafe98ff33f7c51999d5bdb166b27ee613c0667df07485fb3f3a39ffd5f55e', 
'content-length': 385, 'x-amz-meta-s3cmd-attrs': 
'uid:1000/gname:jr/uname:jr/gid:1000/mode:33279/mtime:1430823637/atime:1430823637/md5:b5618e68f5e33ef69eb77010c8627ab2/ctime:1430823637',
 'x-amz-date': '20150505T110045Z', 'content-type': 'text/x-shellscript', 
'Authorization': 'AWS4-HMAC-SHA256 
Credential=XXXXXXXXXXXXXXXXXXXXX/20150505/eu-west-1/s3/aws4_request,SignedHeaders=content-length;content-type;host;x-amz-content-sha256;x-amz-date;x-amz-meta-s3cmd-attrs,Signature=20a2cb2dec6aa86b53374a1311b4f83ab4b8bfc837bec96eac644ac41fca958a'}
DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com
DEBUG: ConnMan.get(): re-using connection: https://mybucket.s3.amazonaws.com#2
DEBUG: format_uri(): /software/rs3-uploadsoftware
 385 of 385   100% in    0s   375.60 kB/sDEBUG: ConnMan.put(): connection put 
back to pool (https://mybucket.s3.amazonaws.com#3)
DEBUG: Response: {'status': 200, 'headers': {'content-length': '0', 
'x-amz-id-2': 
'kounfoONUx/JIr8AKtPmDysFs29AihS7pRjMpgksXoMCIScZRMip6BjIeVL4hF7eF6CoHK6ob+k=', 
'server': 'AmazonS3', 'x-amz-request-id': '8A03C3177FAFB197', 'etag': 
'"b5618e68f5e33ef69eb77010c8627ab2"', 'date': 'Tue, 05 May 2015 11:00:46 GMT'}, 
'reason': 'OK', 'data': '', 'size': 385}
 385 of 385   100% in    0s     4.75 kB/s  done
DEBUG: MD5 sums: computed=b5618e68f5e33ef69eb77010c8627ab2, 
received="b5618e68f5e33ef69eb77010c8627ab2"
DEBUG: Remote Copying from rs3-uploadsoftware to rs3-uploadsoftware~
DEBUG: Unicodising 'software/rs3-uploadsoftware' using UTF-8
DEBUG: Unicodising 'software/rs3-uploadsoftware' using UTF-8
DEBUG: String 'software/rs3-uploadsoftware' encoded to 
'software/rs3-uploadsoftware'
DEBUG: String 'software/rs3-uploadsoftware~' encoded to 
'software/rs3-uploadsoftware%7E'
DEBUG: CreateRequest: resource[uri]=/software/rs3-uploadsoftware%7E
DEBUG: Using signature v4
DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com
DEBUG: canonical_headers = host:mybucket.s3.amazonaws.com
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-copy-source:/mybucket/software/rs3-uploadsoftware
x-amz-date:20150505T110045Z
x-amz-metadata-directive:COPY
x-amz-storage-class:STANDARD

DEBUG: Canonical Request:
PUT
/software/rs3-uploadsoftware~

host:mybucket.s3.amazonaws.com
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-copy-source:/mybucket/software/rs3-uploadsoftware
x-amz-date:20150505T110045Z
x-amz-metadata-directive:COPY
x-amz-storage-class:STANDARD

host;x-amz-content-sha256;x-amz-copy-source;x-amz-date;x-amz-metadata-directive;x-amz-storage-class
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
----------------------
DEBUG: signature-v4 headers: {'x-amz-content-sha256': 
'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 
'x-amz-date': '20150505T110045Z', 'x-amz-storage-class': 'STANDARD', 
'x-amz-copy-source': '/mybucket/software/rs3-uploadsoftware', 'Authorization': 
'AWS4-HMAC-SHA256 
Credential=XXXXXXXXXXXXXXXXXXXXX/20150505/eu-west-1/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-copy-source;x-amz-date;x-amz-metadata-directive;x-amz-storage-class,Signature=7215b6c003739ac0575d2afee07a180b4f3c87a50e2d11235b4dbab263ef7554',
 'x-amz-metadata-directive': 'COPY'}
DEBUG: Processing request, please wait...
DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com
DEBUG: ConnMan.get(): re-using connection: https://mybucket.s3.amazonaws.com#3
DEBUG: format_uri(): /software/rs3-uploadsoftware%7E
DEBUG: Sending request method_string='PUT', 
uri='/software/rs3-uploadsoftware%7E', headers={'x-amz-content-sha256': 
'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 
'x-amz-date': '20150505T110045Z', 'x-amz-storage-class': 'STANDARD', 
'x-amz-copy-source': '/mybucket/software/rs3-uploadsoftware', 'Authorization': 
'AWS4-HMAC-SHA256 
Credential=XXXXXXXXXXXXXXXXXXXXX/20150505/eu-west-1/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-copy-source;x-amz-date;x-amz-metadata-directive;x-amz-storage-class,Signature=7215b6c003739ac0575d2afee07a180b4f3c87a50e2d11235b4dbab263ef7554',
 'x-amz-metadata-directive': 'COPY'}, body=(0 bytes)
DEBUG: Response: {'status': 200, 'headers': {'content-length': '234', 
'x-amz-id-2': 
'zbXUfMzN5MUJXWOW81YM+CmeFdxxEQLYIok8klFLY4tNhhTL0jaJj0N/teaMaX9a/klFc/Se6q4=', 
'server': 'AmazonS3', 'x-amz-request-id': 'B48FDDA9EF20CA7B', 'date': 'Tue, 05 
May 2015 11:00:46 GMT', 'content-type': 'application/xml'}, 'reason': 'OK', 
'data': '<?xml version="1.0" encoding="UTF-8"?>\n<CopyObjectResult 
xmlns="http://s3.amazonaws.com/doc/2006-03-01/";><LastModified>2015-05-05T11:00:46.000Z</LastModified><ETag>&quot;b5618e68f5e33ef69eb77010c8627ab2&quot;</ETag></CopyObjectResult>'}
DEBUG: ConnMan.put(): connection put back to pool 
(https://mybucket.s3.amazonaws.com#4)
DEBUG: String 'software/rs3-uploadsoftware~' encoded to 
'software/rs3-uploadsoftware%7E'
DEBUG: CreateRequest: resource[uri]=/software/rs3-uploadsoftware%7E
DEBUG: Using signature v4
DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com
DEBUG: canonical_headers = host:mybucket.s3.amazonaws.com
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20150505T110045Z

DEBUG: Canonical Request:
HEAD
/software/rs3-uploadsoftware~

host:mybucket.s3.amazonaws.com
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20150505T110045Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
----------------------
DEBUG: signature-v4 headers: {'x-amz-content-sha256': 
'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 
'Authorization': 'AWS4-HMAC-SHA256 
Credential=XXXXXXXXXXXXXXXXXXXXX/20150505/eu-west-1/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-date,Signature=d5b92aafeefe997880a5d54740aaf1a49d212e5ed78842e203072c0f759fbfe8',
 'x-amz-date': '20150505T110045Z'}
DEBUG: Processing request, please wait...
DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com
DEBUG: ConnMan.get(): re-using connection: https://mybucket.s3.amazonaws.com#4
DEBUG: format_uri(): /software/rs3-uploadsoftware%7E
DEBUG: Sending request method_string='HEAD', 
uri='/software/rs3-uploadsoftware%7E', headers={'x-amz-content-sha256': 
'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 
'Authorization': 'AWS4-HMAC-SHA256 
Credential=XXXXXXXXXXXXXXXXXXXXX/20150505/eu-west-1/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-date,Signature=d5b92aafeefe997880a5d54740aaf1a49d212e5ed78842e203072c0f759fbfe8',
 'x-amz-date': '20150505T110045Z'}, body=(0 bytes)
DEBUG: Response: {'status': 200, 'headers': {'content-length': '385', 
'x-amz-id-2': 
'29lpe2xGjPb+OtTQj3qKY9K2OuKaS6YSnKzhc9a/J1hlslAfgDBQxYcXGZqKgFB1nXhhZpjnA5k=', 
'accept-ranges': 'bytes', 'x-amz-meta-s3cmd-attrs': 
'uid:1000/gname:jr/uname:jr/gid:1000/mode:33279/mtime:1430823637/atime:1430823637/md5:b5618e68f5e33ef69eb77010c8627ab2/ctime:1430823637',
 'server': 'AmazonS3', 'last-modified': 'Tue, 05 May 2015 11:00:46 GMT', 
'x-amz-request-id': '9423561E676E997A', 'etag': 
'"b5618e68f5e33ef69eb77010c8627ab2"', 'date': 'Tue, 05 May 2015 11:00:46 GMT', 
'content-type': 'text/x-shellscript'}, 'reason': 'OK', 'data': '', 
's3cmd-attrs': {'uid': '1000', 'gname': 'jr', 'ctime': '1430823637', 'uname': 
'jr', 'gid': '1000', 'mode': '33279', 'mtime': '1430823637', 'atime': 
'1430823637', 'md5': 'b5618e68f5e33ef69eb77010c8627ab2'}}
DEBUG: ConnMan.put(): connection put back to pool 
(https://mybucket.s3.amazonaws.com#5)
remote copy: rs3-uploadsoftware -> rs3-uploadsoftware~
DEBUG: Process files that was not remote copied
Done. Uploaded 385 bytes in 1.0 seconds, 385.00 B/s. Copied 1 files saving 385 
bytes transfer.
/data/WorkInProgressSSD/s3dev/rs3BackupSystem/software $

------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y

_______________________________________________
S3tools-general mailing list
S3tools-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/s3tools-general

[S3tools-general] Not deleting on sync, empty object message

Reply via email to