Re: [Openstack] Swift3 bucket naming conventions

2018-07-17 Thread Shyam Prasad N
y have underscores in them... almost any >> character is valid. >> >> But I guess s3api thinks that's maybe not a valid bucket name? >> >> https://github.com/openstack/swift/blob/master/test/unit/com >> mon/middleware/s3api/test_utils.py#L38 >> >> -C

[Openstack] Swift3 bucket naming conventions

2018-06-21 Thread Shyam Prasad N
Hi, On my openstack swift s3 interface, I tried to create bucket names similar to what I have in my AWS S3. But swift3 doesn't seem to allow bucket names containing underscore. Once I remove the underscore and try to create the bucket, it works. Is there a way to overcome this? -- -Shyam ___

Re: [Openstack] Struggling to get the s3 api interface to work with swift.

2018-06-21 Thread Shyam Prasad N
I forgot to close loop on this. I managed to solve this problem with a config change in /etc/swift/proxy-server.conf: I needed to include the line: auth_version = 3 under [filter:s3token] On Fri, Jun 1, 2018 at 5:02 PM, Shyam Prasad N wrote: > Hi Kota, > > I tried with the ch

Re: [Openstack] Struggling to get the s3 api interface to work with swift.

2018-06-01 Thread Shyam Prasad N
5hJOnwY4dyFk0PIxHHwmVcA= > >> Content-Length: 0 > > then, the string to sign should include the info corretly. > > Looking at s3curl code, it looks to fall into cname case? > > https://github.com/scality/S3/blob/master/tests/functional/ > s3curl/s3curl.pl#L311-L328 > > Onc

Re: [Openstack] Struggling to get the s3 api interface to work with swift.

2018-05-31 Thread Shyam Prasad N
098b6578, > swift3 doesn't require the account in the path so far as well as actual > amazon s3. > > Best, > Kota > > (2018/05/31 21:33), Shyam Prasad N wrote: > > Hi Yuxin, > > > > Thank you for sharing your configs. > > So I'v

Re: [Openstack] Struggling to get the s3 api interface to work with swift.

2018-05-31 Thread Shyam Prasad N
t-openrc > swift list > > 3.Create a credential > > openstack credential create --type ec2 --project testproject testuser > '{"access": "testaccess", "secret": "testsecret"}' > > 4. Use it in s3curl > > add the endpoint url to

Re: [Openstack] Struggling to get the s3 api interface to work with swift.

2018-05-25 Thread Shyam Prasad N
#x27;m not missing anything in configuration. Regards, Shyam On Fri, May 25, 2018 at 3:05 PM, Shyam Prasad N wrote: > Tried that. Unfortunately same error. > Is there anything I can do to troubleshoot this? > > On Fri, May 25, 2018 at 2:56 PM, Yuxin Wang > wrote: > >> They

Re: [Openstack] Struggling to get the s3 api interface to work with swift.

2018-05-25 Thread Shyam Prasad N
Tried that. Unfortunately same error. Is there anything I can do to troubleshoot this? On Fri, May 25, 2018 at 2:56 PM, Yuxin Wang wrote: > They can be any strings. > > Replace them with whatever you want. > > - Yuxin > > 在 2018年5月25日,14:57,Shyam Prasad N 写道: > > T

Re: [Openstack] Struggling to get the s3 api interface to work with swift.

2018-05-25 Thread Shyam Prasad N
software > hadn't been updated in about a year, and the newest release was > incompatible with the version of OpenStack that we were selling. > > On Thu, May 24, 2018 at 11:57 PM, Shyam Prasad N > wrote: > >> Thanks. I'll try this. >> But what values do I use in

Re: [Openstack] Struggling to get the s3 api interface to work with swift.

2018-05-25 Thread Shyam Prasad N
spectrum.scale.v4r11.adv.doc/bl1adv_ > ConfigureOpenstackEC2credentials.htm > > 在 2018年5月25日,10:32,Shyam Prasad N 写道: > > Yes, I did. > I don't think this is s3curl related issue, because I tried with python > AWS SDK, and got the same error. > > On Fri, May 25,

[Openstack] Struggling to get the s3 api interface to work with swift.

2018-05-24 Thread Shyam Prasad N
Hi, I've been trying to get swift3 to work for several days now. But I haven't managed to get it running. Both with tempauth and keystoneauth, I'm getting the same error: eightkpc@objectstore1:~/s3curl$ ./s3curl.pl --id=testerks -- http://127.0.0.1:8080/ SignatureDoesNotMatchThe request signatur

[Openstack] Not able to use openstack swift using the s3 api plugin...

2018-05-03 Thread Shyam Prasad N
Hi, I tried installing the swift3 plugin using the following link: https://docs.openstack.org/mitaka/config-reference/object-storage/configure-s3.html However, I'm not able to perform the operations: # ./s3curl.pl --id=personal -get -- -s -v http://proxy-server:8080 Unknown option: get * Rebuilt

[Openstack] Swift3 configuration...

2018-04-17 Thread Shyam Prasad N
Hi, I'm trying to setup an s3 API frontend for my swift cluster using this guide: https://docs.openstack.org/mitaka/config-reference/object-storage/configure-s3.html But I'm unable to figure out how to configure the access_key_id and secret_access_key. The page says I should pick up from aws cons

Re: [Openstack] Domain not found error

2018-04-17 Thread Shyam Prasad N
> keystone is essential to all other services, so you wouldn't do too much > damage. > Another way would be to login to your database and change the respective > values, but since I don't know what exactly the bootstrap command does I > would not recommend this option. >

Re: [Openstack] Domain not found error

2018-04-16 Thread Shyam Prasad N
lso points to 35357 again, so this is probably a bug. > > You should fix this prior to any further steps. > > > > Zitat von Shyam Prasad N : > > Here is the documentation page I followed: >> https://docs.openstack.org/keystone/queens/install/keystone- >

Re: [Openstack] Domain not found error

2018-04-16 Thread Shyam Prasad N
Here is the documentation page I followed: https://docs.openstack.org/keystone/queens/install/keystone-install-ubuntu.html On Mon, Apr 16, 2018 at 3:14 PM, Shyam Prasad N wrote: > Hi Eugen, > > Ignore the different IPs. I had tried keystone install on two different > systems. The

Re: [Openstack] Domain not found error

2018-04-16 Thread Shyam Prasad N
reflect the configuration you bootstrapped with keystone-manage. > > Change your admin-rc to point to the correct IP and the correct port, then > retry the domain list command after sourcing the credentials. > > > > Zitat von Shyam Prasad N : > > Hi, >> >> Sorry

Re: [Openstack] Domain not found error

2018-04-15 Thread Shyam Prasad N
Eugen Block : > > > The missing command has been in Newton, Ocata and Pike release. They fixed >> it in Queens again. >> >> I filed a bug report: https://bugs.launchpad.net/keystone/+bug/1763297 >> >> Regards >> >> >> Zitat von Shyam Prasad

Re: [Openstack] Domain not found error

2018-04-12 Thread Shyam Prasad N
Thanks Eugen :) On Thu, Apr 12, 2018, 13:57 Eugen Block wrote: > The missing command has been in Newton, Ocata and Pike release. They > fixed it in Queens again. > > I filed a bug report: https://bugs.launchpad.net/keystone/+bug/1763297 > > Regards > > > Zitat von Sh

Re: [Openstack] Domain not found error

2018-04-12 Thread Shyam Prasad N
> > Did the keystone-manage bootstrap command work? > Yes. It did not throw any errors. > > Regards > > > Zitat von Shyam Prasad N : > > > Hi, >> >> I'm trying to install keystone for my swift cluster. >> I followed this document for

[Openstack] Domain not found error

2018-04-11 Thread Shyam Prasad N
Hi, I'm trying to install keystone for my swift cluster. I followed this document for install and configuration: https://docs.openstack.org/keystone/pike/install/ However, I'm getting this error for a command: # openstack user create --domain default --password-prompt swift The request you have m

[Openstack] EC stability status in openstack swift

2018-03-23 Thread Shyam Prasad N
Hi, I wanted to understand the stability of the erasure coding feature in openstack swift. Is it in widespread production use? We're exploring the possibility of using EC instead of replication on few of our servers which are not so loaded in terms of storage capacity. Also, I expect EC to be more

Re: [Openstack] [openstack-dev] 503 Errors for PUT and POST calls....

2017-08-11 Thread Shyam Prasad N
ave permissions?) > > Hope you can get it squared. You might jump in IRC and join > #openstack-swift on Freenode for some more iterative feedback (I'd recommend > irccloud.com if you're new to IRC). > > GL, > > -Clay > > > On Tue, Aug 8, 2017 at 2:54 AM

[Openstack] 503 Errors for PUT and POST calls....

2017-08-08 Thread Shyam Prasad N
Hi, In my openstack swift cluster, I'm seeing a lot of 503 errors as a result of tracebacks in swift logs with "No such file or directory" exceptions... # grep -Rnw txdaba05e70c6b4dfaa5884-0059895aca /var/log/swift/* /var/log/swift/proxy.error:31030:Aug 7 23:31:39 BulkStore-c2f99bd4-75ce-11e7-b53

Re: [Openstack] [Swift] Object replication...

2016-12-13 Thread Shyam Prasad N
pped to an older version? Please note that I'm okay to sacrifice high availability, if that ensures that the data is strictly consistent. Regards, Shyam On Dec 13, 2016 22:46, "John Dickinson" wrote: On 13 Dec 2016, at 0:21, Shyam Prasad N wrote: Hi, I have an openstack swift cl

[Openstack] [Swift] Object replication...

2016-12-13 Thread Shyam Prasad N
Hi, I have an openstack swift cluster with 2 nodes, and a replication count of 2. So, theoretically, during a PUT request, both replicas are updated synchronously. Only then the request will return a success. Please correct me if I'm wrong on this. I have a script that periodically does a PUT to

[Openstack] Geo-replicated cluster...

2015-06-23 Thread Shyam Prasad N
Hi, I'm planning to setup a geo-replicated swift cluster and run an application which will use this cluster as a backend. I understand that the two mechanisms that support this are container sync and region based disk location. I'm okay with synchronization being asynchronous (synchronous replica

Re: [Openstack] Swift setup with replica count of two and node down...

2015-04-28 Thread Shyam Prasad N
Thanks Hugo. On Tuesday 28 April 2015 07:25 PM, Kuo Hugo wrote: Btw, for operational questions. Please post to https://ask.openstack.org/en/questions/ . It's a better place for anyone would like to ask same question in the future. Thanks // Hugo 2015-04-28 17:57 GMT+08:00 Shyam Pra

Re: [Openstack] Swift setup with replica count of two and node down...

2015-04-28 Thread Shyam Prasad N
, 2015 at 3:27 PM, Shyam Prasad N wrote: > Hi, > > I have a setup with object replica count of 2. The setup has 2 machines > (say A and B), with 2 disks (sdb and sdc) in each machine. > > An object X is created when the whole setup (both A and B) is up and > running. A is

[Openstack] Swift setup with replica count of two and node down...

2015-04-28 Thread Shyam Prasad N
Hi, I have a setup with object replica count of 2. The setup has 2 machines (say A and B), with 2 disks (sdb and sdc) in each machine. An object X is created when the whole setup (both A and B) is up and running. A is down for maintenance. What is the expected behaviour for this setup when: 1. G

Re: [Openstack] Remove storage from the rings and then re-add..

2014-10-20 Thread Shyam Prasad N
Thanks for the reply, Sam. Will explore this option. BTW, I'm running the Havana release of swift. Did swift have the above features in this release? Regards, Shyam On Mon, Oct 20, 2014 at 10:12 PM, Samuel Merritt wrote: > On 10/19/14, 11:24 PM, Shyam Prasad N wrote: > >&g

[Openstack] Remove storage from the rings and then re-add..

2014-10-19 Thread Shyam Prasad N
Hi, I've written a few scripts to make adding of storage to swift cluster easier: remakerings: removes existing ring files and builds new empty rings. addtorings: adds new IP:DISK pair to existing rings. removefromrings: removes an IP:DISK pair from existing rings. I'm facing a problem in one sce

[Openstack] Swift global cluster replication latency...

2014-08-18 Thread Shyam Prasad N
Hi, Went through the following link: https://swiftstack.com/blog/2012/09/16/globally-distributed-openstack-swift-cluster/ I'm trying to simulate the 2-region 3-replica scenario. The document says that the 3rd replica will be asynchronously moved to the remote location with a 2-region setup. What

[Openstack] Replication count change on running cluster...

2014-07-06 Thread Shyam Prasad N
Hi, Is it possible to change the ring replication count for a cluster which is already running, and has data? >From what I read, I'll need to recreate the rings with new replication count. But this will clear all my existing data in the cluster. Right? Thanks in advance for the replies. -- -Shya

Re: [Openstack] Replication count..

2014-07-04 Thread Shyam Prasad N
can’t figure out what is going wrong from the proxy server logs can > you post the o/p of the following 2 commands: > > > > swift-ring-builder /etc/swift/object.builder > > swift-get-nodes /etc/swift/object.ring.gz blah blah blah > > > > Gerry. > > > > *

[Openstack] Replication count..

2014-07-04 Thread Shyam Prasad N
Hi, I have a swift setup with 2 disks each on 2 nodes. The swift rings have been setup with replication count of 2, with each node with unique zone id. After creation of a few objects, I pulled out one of the disks from node1. After some more object creations, I pulled out the remaining swift disk

Re: [Openstack] Bad perf on swift servers...

2014-05-30 Thread Shyam Prasad N
> replication traffic now. > > 4. To have a detail network topology diagram will help. > > Hugo Kuo > > > 2014-05-29 1:06 GMT+08:00 Shyam Prasad N : > >> Hi, >> >> Confused about the right mailing list to ask this question. So including >> both

[Openstack] Bad perf on swift servers...

2014-05-28 Thread Shyam Prasad N
Hi, Confused about the right mailing list to ask this question. So including both openstack and openstack-dev in the CC list. I'm running a swift cluster with 4 nodes. All 4 nodes are symmetrical. i.e. proxy, object, container, and account servers running on each with similar storage configuratio