There are a couple of oddities when running s3cmd version 1.5.2 on Linux
Mint 17. (Neither of these are a problem for me but offered just to make
you aware).
I already reported (5 May) that I get spurious messages "WARNING: Empty
object name on S3 found, ignoring."
I also found that when performing a simple get the command is echoed twice,
which I wouldn't expect is normal behaviour. Sanitised debug output attached
$ s3cmd get s3://mybucket/files/file1
s3://mybucket/files/file1 -> ./file1 [1 of 1]
s3://mybucket/files/file1 -> ./file1 [1 of 1]
32802 of 32802 100% in 0s 149.34 kB/s done
$
Regards
Russell
/tmp/yyy $ s3cmd --debug get s3://mybucket/files/file1
DEBUG: ConfigParser: Reading file '/home/jr/.s3cfg'
DEBUG: ConfigParser: access_key->AK...17_chars...Q
DEBUG: ConfigParser: access_token->
DEBUG: ConfigParser: add_encoding_exts->
DEBUG: ConfigParser: add_headers->
DEBUG: ConfigParser: bucket_location->eu-west
DEBUG: ConfigParser: ca_certs_file->
DEBUG: ConfigParser: cache_file->
DEBUG: ConfigParser: check_ssl_certificate->True
DEBUG: ConfigParser: cloudfront_host->cloudfront.amazonaws.com
DEBUG: ConfigParser: default_mime_type->binary/octet-stream
DEBUG: ConfigParser: delay_updates->False
DEBUG: ConfigParser: delete_after->False
DEBUG: ConfigParser: delete_after_fetch->False
DEBUG: ConfigParser: delete_removed->False
DEBUG: ConfigParser: dry_run->False
DEBUG: ConfigParser: enable_multipart->True
DEBUG: ConfigParser: encoding->UTF-8
DEBUG: ConfigParser: encrypt->False
DEBUG: ConfigParser: expiry_date->
DEBUG: ConfigParser: expiry_days->
DEBUG: ConfigParser: expiry_prefix->
DEBUG: ConfigParser: follow_symlinks->False
DEBUG: ConfigParser: force->False
DEBUG: ConfigParser: get_continue->False
DEBUG: ConfigParser: gpg_command->/usr/bin/gpg
DEBUG: ConfigParser: gpg_decrypt->%(gpg_command)s -d --verbose --no-use-agent
--batch --yes --passphrase-fd %(passphrase_fd)s -o %(output_file)s
%(input_file)s
DEBUG: ConfigParser: gpg_encrypt->%(gpg_command)s -c --verbose --no-use-agent
--batch --yes --passphrase-fd %(passphrase_fd)s -o %(output_file)s
%(input_file)s
DEBUG: ConfigParser: gpg_passphrase->x8...17_chars...7
DEBUG: ConfigParser: guess_mime_type->True
DEBUG: ConfigParser: host_base->s3.amazonaws.com
DEBUG: ConfigParser: host_bucket->%(bucket)s.s3.amazonaws.com
DEBUG: ConfigParser: human_readable_sizes->False
DEBUG: ConfigParser: ignore_failed_copy->False
DEBUG: ConfigParser: invalidate_default_index_on_cf->False
DEBUG: ConfigParser: invalidate_default_index_root_on_cf->True
DEBUG: ConfigParser: invalidate_on_cf->False
DEBUG: ConfigParser: list_md5->False
DEBUG: ConfigParser: log_target_prefix->
DEBUG: ConfigParser: max_delete->-1
DEBUG: ConfigParser: mime_type->
DEBUG: ConfigParser: multipart_chunk_size_mb->8
DEBUG: ConfigParser: preserve_attrs->True
DEBUG: ConfigParser: progress_meter->True
DEBUG: ConfigParser: proxy_host->
DEBUG: ConfigParser: proxy_port->0
DEBUG: ConfigParser: put_continue->False
DEBUG: ConfigParser: recursive->False
DEBUG: ConfigParser: recv_chunk->4096
DEBUG: ConfigParser: reduced_redundancy->False
DEBUG: ConfigParser: restore_days->1
DEBUG: ConfigParser: secret_key->tg...37_chars...v
DEBUG: ConfigParser: send_chunk->4096
DEBUG: ConfigParser: server_side_encryption->False
DEBUG: ConfigParser: signature_v2->False
DEBUG: ConfigParser: simpledb_host->sdb.amazonaws.com
DEBUG: ConfigParser: skip_existing->False
DEBUG: ConfigParser: socket_timeout->300
DEBUG: ConfigParser: urlencoding_mode->normal
DEBUG: ConfigParser: use_https->True
DEBUG: ConfigParser: use_mime_magic->True
DEBUG: ConfigParser: verbosity->WARNING
DEBUG: ConfigParser:
website_endpoint->http://%(bucket)s.s3-website-%(location)s.amazonaws.com/
DEBUG: ConfigParser: website_error->
DEBUG: ConfigParser: website_index->index.html
DEBUG: Updating Config.Config cache_file ->
DEBUG: Updating Config.Config follow_symlinks -> False
DEBUG: Updating Config.Config verbosity -> 10
DEBUG: Unicodising 'get' using UTF-8
DEBUG: Unicodising 's3://mybucket/files/file1' using UTF-8
DEBUG: Command: get
DEBUG: Applying --exclude/--include
DEBUG: CHECK: file1
DEBUG: PASS: u'file1'
INFO: Summary: 1 remote files to download
DEBUG: DeUnicodising u'./file1' using UTF-8
DEBUG: Unicodising './file1' using UTF-8
DEBUG: String 'files/file1' encoded to 'files/file1'
DEBUG: CreateRequest: resource[uri]=/files/file1
DEBUG: Using signature v4
DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com
DEBUG: canonical_headers = host:mybucket.s3.amazonaws.com
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20150521T060609Z
DEBUG: Canonical Request:
GET
/files/file1
host:mybucket.s3.amazonaws.com
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20150521T060609Z
host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
----------------------
DEBUG: signature-v4 headers: {'x-amz-content-sha256':
'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855',
'Authorization': 'AWS4-HMAC-SHA256
Credential=ACCESSKEY/20150521/eu-west/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-date,Signature=fbe921d0d28449cc0e6de6a426029ac87529f631ad8f684ea6fee721f7cc705a',
'x-amz-date': '20150521T060609Z'}
s3://mybucket/files/file1 -> ./file1 [1 of 1]
DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com
DEBUG: ConnMan.get(): creating new connection: https://mybucket.s3.amazonaws.com
DEBUG: Using ca_certs_file None
DEBUG: non-proxied HTTPSConnection(mybucket.s3.amazonaws.com)
DEBUG: format_uri(): /files/file1
DEBUG: Response: {'status': 400, 'headers': {'x-amz-id-2':
'hs+3WVxXTAhs2A2NnUJS8sEk6UKOfL/uNOW2p2eYZYYYVa0RTkH8/d5SAnS/VAnkteXd42XAAmo=',
'server': 'AmazonS3', 'transfer-encoding': 'chunked', 'connection': 'close',
'x-amz-request-id': '0C3BD9A49D0197E1', 'date': 'Thu, 21 May 2015 06:06:08
GMT', 'content-type': 'application/xml'}, 'reason': 'Bad Request'}
DEBUG: Falling back to signature v2
DEBUG: Using signature v2
DEBUG: SignHeaders:
'GET\n\n\n\nx-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855\nx-amz-date:Thu,
21 May 2015 06:06:09 +0000\n/mybucket/files/file1'
s3://mybucket/files/file1 -> ./file1 [1 of 1]
DEBUG: get_hostname(mybucket): mybucket.s3.amazonaws.com
DEBUG: ConnMan.get(): creating new connection: https://mybucket.s3.amazonaws.com
DEBUG: non-proxied HTTPSConnection(mybucket.s3.amazonaws.com)
DEBUG: format_uri(): /files/file1
DEBUG: Response: {'status': 200, 'headers': {'content-length': '32802',
'x-amz-id-2':
'ku7FSE3MRyEHiVXQVRafYqAb/EPfzkYpb80JqaTTUpTjRbqUoiLXmdpbN2SooId5UwUQlIslN7s=',
'accept-ranges': 'bytes', 'server': 'AmazonS3', 'last-modified': 'Thu, 14 May
2015 18:11:04 GMT', 'x-amz-request-id': '5CF874A9240A4B99', 'etag': '"file1"',
'date': 'Thu, 21 May 2015 06:06:10 GMT', 'content-type': 'text/plain'},
'reason': 'OK'}
4096 of 32802 12% in 0s 25.21 kB/sDEBUG: ConnMan.put(): connection
put back to pool (https://mybucket.s3.amazonaws.com#1)
32802 of 32802 100% in 0s 175.99 kB/s done
DEBUG: ReceiveFile: Computed MD5 = file1
DEBUG: set mtime to 1431623464.0
/tmp/yyy $
------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
_______________________________________________
S3tools-general mailing list
S3tools-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/s3tools-general
