Hi Florent,
Am I missing anything, on why this is not working for me.
Can I get some help on this ? whether the below config values are correct ?
or let meknow if you need more information.
I am finding it difficult to support swift openstack using the s3cmd.
Thanks
-kiru
*From:* Kirubakaran Kaliannan [mailto:kiru...@zadarastorage.com]
*Sent:* Tuesday, January 26, 2016 10:44 AM
*To:* 's3tools-general@lists.sourceforge.net'
*Subject:* RE: [S3tools-general] question s3cmd to support openstack (SWIFT)
Thanks Florent.
I have tried setting the host_bucket/host_base, like below (tried with
ipaddress/hostname (with port and no port)), but still have issues using
the s3cmd.
If I set “proxy_host” it fails with “use_ssl not be https”.
Am I missing any thing else. Below is my .s3cfg config file
This works well if I create directory name with (_) in it.
[default]
access_key = 97f885c5ca3549cbaa06be07805f3a52
access_token =
add_content_encoding = True
add_encoding_exts =
add_headers =
bucket_location = US
cache_file =
cloudfront_host =
default_mime_type = binary/octet-stream
delay_updates = False
delete_after = False
delete_after_fetch = False
delete_removed = False
dry_run = False
enable_multipart = True
encoding = ANSI_X3.4-1968
encrypt = False
follow_symlinks = False
force = False
get_continue = False
gpg_command = /usr/bin/gpg
gpg_decrypt = %(gpg_command)s -d --verbose --no-use-agent --batch --yes
--passphrase-fd %(passphrase_fd)s -o %(output_file)s %(input_file)s
gpg_encrypt = %(gpg_command)s -c --verbose --no-use-agent --batch --yes
--passphrase-fd %(passphrase_fd)s -o %(output_file)s %(input_file)s
gpg_passphrase = 123
guess_mime_type = True
*host_base = 150.50.2.120:443 <http://150.50.2.120:443>*
*host_bucket = 150.50.2.120:443 <http://150.50.2.120:443>*
human_readable_sizes = False
ignore_failed_copy = False
invalidate_default_index_on_cf = False
invalidate_default_index_root_on_cf = True
invalidate_on_cf = False
list_md5 = False
log_target_prefix =
max_delete = -1
mime_type =
multipart_chunk_size_mb = 15
preserve_attrs = True
progress_meter = True
proxy_host = 150.50.2.120
proxy_port = 0
put_continue = False
recursive = False
recv_chunk = 4096
reduced_redundancy = False
secret_key = c7f327b012ac41198b079480304d6784
send_chunk = 4096
server_side_encryption = False
simpledb_host = sdb.amazonaws.com
skip_existing = False
socket_timeout = 300
source_address =
urlencoding_mode = normal
*use_https = True*
use_mime_magic = True
verbosity = WARNING
website_endpoint = http://%(bucket)s.s3-website-%(location)s.amazonaws.com/
website_error =
website_index = index.html
signature_v2 = True
Thanks
-kiru
*From:* Florent Viard [mailto:florent.vi...@seagate.com
<florent.vi...@seagate.com>]
*Sent:* Monday, January 25, 2016 9:26 PM
*To:* s3tools-general
*Subject:* Re: [S3tools-general] question s3cmd to support openstack (SWIFT)
Hi Kirubakaran,
There is no need for your patch, you just need to edit your s3cfg config
file and modify the following 2 keys:
host_base
host_bucket
In both of them, your will have to remove the "%(bucket)" tag, and then
s3cmd will use the "path based" format that works right with swift3.
I'm used to work with a swift3 based service and it works ok.
But take note that swift3 will still has some annoying limitations.
Regards,
--
Florent
On Mon, Jan 25, 2016 at 1:46 PM, Kirubakaran Kaliannan <
kiru...@zadarastorage.com> wrote:
Hi ,
Openstack object store (SWIFT) has the swift3 middleware to provide S3
compatible API’s.
But, S3cmd is failing to work on the openstack as the URI (format_uri()) is
not formed correctly.
Do we have plan to support open-stack ? Following are the code change, we
have made to get this working. (similar fix is done on another github
branch forked out of this)
Please let me know if this support is in the roadmap of s3cmd development ?
*diff --git a/s3cmd/s3cmd/S3/Config.py b/s3cmd/s3cmd/S3/Config.py*
*index 82aa809..13bd44d 100644*
*--- a/s3cmd/s3cmd/S3/Config.py*
*+++ b/s3cmd/s3cmd/S3/Config.py*
*@@ -46,6 +46,9 @@ class Config(object):*
* acl_public = None*
* acl_grants = []*
* acl_revokes = []*
*+ swift_compatible = False*
* proxy_host = ""*
* proxy_port = 3128*
* encrypt = False*
*diff --git a/s3cmd/s3cmd/S3/S3.py b/s3cmd/s3cmd/S3/S3.py*
*index cd4a404..ead1c4e 100644*
*--- a/s3cmd/s3cmd/S3/S3.py*
*+++ b/s3cmd/s3cmd/S3/S3.py*
*@@ -209,8 +209,14 @@ class S3(object):*
* def format_uri(self, resource):*
* if resource['bucket'] and not
check_bucket_name_dns_conformity(resource['bucket']):*
* uri = "/%s%s" % (resource['bucket'], resource['uri'])*
* else:*
*- uri = resource['uri']*
*+ if self.config.swift_compatible and resource['bucket']:*
*+ uri = "/%s%s" % (resource['bucket'], resource['uri'])*
*+ else:*
*+ uri = resource['uri']*
*+ debug('uri = %s/%s' %(uri, self.config.swift_compatible))*
* if self.config.proxy_host != "":*
* uri = "http://%s%s <http://%25s%25s>" %
(self.get_hostname(resource['bucket']), uri)*
* debug('format_uri(): ' + uri)*
Thanks
-kiru
------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
https://urldefense.proofpoint.com/v2/url?u=http-3A__pubads.g.doubleclick.net_gampad_clk-3Fid-3D267308311-26iu-3D_4140&d=CwICAg&c=IGDlg0lD0b-nebmJJ0Kp8A&r=GEhQqSrCDlzPsOu9ww_S8dL0RpfPwWzg7DpciZD7d7Y&m=_ruIdFaqeQO6oeGokQKi6VrWNRLlglQGxwoQWoMGIMo&s=wMXnxK3-1bRSpDSJXDPTHUnCAkdkgbkPnVq3n3URYSs&e=
_______________________________________________
S3tools-general mailing list
S3tools-general@lists.sourceforge.net
https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.sourceforge.net_lists_listinfo_s3tools-2Dgeneral&d=CwICAg&c=IGDlg0lD0b-nebmJJ0Kp8A&r=GEhQqSrCDlzPsOu9ww_S8dL0RpfPwWzg7DpciZD7d7Y&m=_ruIdFaqeQO6oeGokQKi6VrWNRLlglQGxwoQWoMGIMo&s=rKVfHl2ktjsbx8EL0OTuQ_KmoGdbO77BeiMCjesiSrE&e=
------------------------------
No virus found in this message.
Checked by AVG - www.avg.com
Version: 2016.0.7357 / Virus Database: 4522/11488 - Release Date: 01/26/16
------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311&iu=/4140
_______________________________________________
S3tools-general mailing list
S3tools-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/s3tools-general
