Re: [ceph-users] Radosgw Timeout

2014-05-22 Thread Yehuda Sadeh
On Thu, May 22, 2014 at 6:16 AM, Georg Höllrigl wrote: > Hello List, > > Using the radosgw works fine, as long as the amount of data doesn't get too > big. > > I have created one bucket that holds many small files, separated into > different "directories". But whenever I try to acess the bucket, I

Re: [ceph-users] Unable to update Swift ACL's on existing containers

2014-05-22 Thread Yehuda Sadeh
That looks like a bug; generally the permission checks there are broken. I opened issue #8428, and pushed a fix on top of the firefly branch to wip-8428. Thanks! Yehuda On Thu, May 22, 2014 at 2:49 PM, James Page wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA256 > > Hi Folks > > I'm see

Re: [ceph-users] Problem with radosgw and some file name characters

2014-06-02 Thread Yehuda Sadeh
rver 1 > or server 2. > > I've noticed that if I go directly (Internet <--> Radosgw_Server_1) I do not > have any issues with special characters. > > Any idea what I am missing? Perhaps something needs changing on the proxy > server? > > Cheers > > Andrei > >

Re: [ceph-users] RGW: Multi Part upload and resulting objects

2014-06-04 Thread Yehuda Sadeh
On Wed, Jun 4, 2014 at 8:49 AM, Gregory Farnum wrote: > On Wed, Jun 4, 2014 at 7:58 AM, Sylvain Munaut > wrote: >> Hi, >> >> >> During a multi part upload you can't upload parts smaller than 5M, and >> radosgw also slices object in slices of 4M. Having those two being >> different is a bit unfort

Re: [ceph-users] RGW: Multi Part upload and resulting objects

2014-06-05 Thread Yehuda Sadeh
Right. It only matters for newly created objects. On Thu, Jun 5, 2014 at 10:01 AM, Gregory Farnum wrote: > I don't believe that should cause any issues; the chunk sizes are in > the metadata. > -Greg > Software Engineer #42 @ http://inktank.com | http://ceph.com > > > On Thu, Jun 5, 2014 at 12:2

Re: [ceph-users] radosgw-admin log show

2014-06-05 Thread Yehuda Sadeh
On Thu, Jun 5, 2014 at 8:42 PM, Derek Yarnell wrote: > On 11/28/13, 4:18 AM, Dan Van Der Ster wrote: >> Dear users/experts, >> Does anyone know how to use radosgw-admin log show? It seems to not properly >> read the --bucket parameter. >> >> # radosgw-admin log show --bucket=asdf --date=2013-11-2

Re: [ceph-users] Swift API Authentication Failure

2014-06-06 Thread Yehuda Sadeh
On Wed, Jun 4, 2014 at 12:00 PM, David Curtiss wrote: > Over the last two days, I set up ceph on a set of ubuntu 12.04 VMs (my first > time working with ceph), and it seems to be working fine (I have HEALTH_OK, > and can create a test document via the rados commandline tool), but I can't > authent

Re: [ceph-users] Swift API Authentication Failure

2014-06-10 Thread Yehuda Sadeh
pp...@ni.com > radosgw-admin subuser create --uid=hive_cache --subuser=hive_cache:swift > --access=full > radosgw-admin key create --subuser=hive_cache:swift --key-type=swift > --secret=QFAMEDSJP5DEKJO0DDXY > > - David > > > On Mon, Jun 9, 2014 at 11:14 PM, Yehuda Sadeh wr

Re: [ceph-users] Swift API Authentication Failure

2014-06-11 Thread Yehuda Sadeh
rd KB wrwr KB > ... > .users.swift- 110 >0 00011 > > For comparison, the 'df' line for the .users pool lists 2 objects, which > a

Re: [ceph-users] civetweb frontend issue with spurious response

2014-06-16 Thread Yehuda Sadeh
The second response is a response to an expected follow up request on the same connection (using keep alive). If you're seeing it as part of the response on the first request then it's either an issue with the client not handling keep alive connections correctly, or an issue with the content length

Re: [ceph-users] Problem with RadosGW and special characters

2014-06-26 Thread Yehuda Sadeh
The gateway itself supports these kind of characters. Usually we see this issue when there's something in front of the web server (like a load balancer) that modifies the requests. Another possibility is the web server configuration that might be rewriting the requests. In this case it seems that y

Re: [ceph-users] Issues with federated gateway sync

2014-07-21 Thread Yehuda Sadeh
On Mon, Jul 21, 2014 at 1:07 PM, Justice London wrote: > Hello, I am having issues getting FG working between east/west data-center > test configurations. I have the sync default.conf configured like this: > > source: "http://10.20.2.39:80"; > src_zone: "us-west-1" > src_access_key: > src_secret_

Re: [ceph-users] Radosgw bucket index (bilog) and multi part upload - strange behaviour

2014-07-30 Thread Yehuda Sadeh
On Wed, Jul 30, 2014 at 8:24 AM, Patrycja Szabłowska wrote: > Hi, > > > I've noticed a strange thing about the ceph's bucket index today. I'm > using ceph 0.80 from github. > I've uploaded successfully a file using multipart upload (script based > on the one included here: > http://lists.ceph.com/

Re: [ceph-users] Some questions of radosgw

2014-08-04 Thread Yehuda Sadeh
On Fri, Aug 1, 2014 at 9:49 AM, Osier Yang wrote: > [ correct the URL ] > > > On 2014年08月02日 00:42, Osier Yang wrote: >> >> Hi, list, >> >> I managed to setup radosgw in testing environment to see if it's >> stable/mature enough >> for production use these several days. In the meanwhile, I tried t

Re: [ceph-users] RadosGW problems

2014-08-19 Thread Yehuda Sadeh
On Tue, Aug 19, 2014 at 5:32 AM, Marco Garcês wrote: > > UPDATE: > > I have installed Tengine (nginx fork) and configured both HTTP and HTTPS to > use radosgw socket. Looking back at this thread, and considering this solution it seems to me that you were running the wrong apache fastcgi module.

Re: [ceph-users] do RGW have billing feature? If have, how do we use it ?

2014-08-27 Thread Yehuda Sadeh
There's the usage log that can be turned on and is in the granularity of 1 hour. It basically records amount of data transferred, bucket name, number of operations, and types of operations. Yehuda On Wed, Aug 27, 2014 at 1:59 PM, Craig Lewis wrote: > Not directly, no. > > There is data recorded

Re: [ceph-users] Ceph object back up details

2014-09-08 Thread Yehuda Sadeh
Not sure I understand what you ask. Multiple zones within the same region configuration is described here: http://ceph.com/docs/master/radosgw/federated-config/#multi-site-data-replication Yehuda On Sun, Sep 7, 2014 at 10:32 PM, M Ranga Swami Reddy wrote: > Hi Yahuda, > I need more info on Ceph

Re: [ceph-users] why no likely() and unlikely() used in Ceph's source code?

2014-09-15 Thread Yehuda Sadeh
I agree with Greg. When dealing with the latencies that we deal with due to different IO operations (networking, storage), it's mostly not worth the trouble. I think the main reason we didn't actually put it to use is that we forgot we've had this macro defined, and it really wasn't worth the troub

Re: [ceph-users] Any way to remove possible orphaned files in a federated gateway configuration

2014-09-23 Thread Yehuda Sadeh
On Tue, Sep 23, 2014 at 3:05 PM, Lyn Mitchell wrote: > Is anyone aware of a way to either reconcile or remove possible orphaned > “shadow” files in a federated gateway configuration? The issue we’re seeing > is the number of chunks/shadow files on the slave has many more “shadow” > files than the

Re: [ceph-users] (keystone + radosgw ) users

2013-07-08 Thread Yehuda Sadeh
> De: ceph-users-boun...@lists.ceph.com > [mailto:ceph-users-boun...@lists.ceph..com] En nombre de Alvaro Izquierdo > Jimeno > Enviado el: viernes, 05 de julio de 2013 11:58 > Para: Yehuda Sadeh > CC: ceph-users@lists.ceph.com > Asunto: Re: [ceph-users] (keystone + radosgw ) users &

Re: [ceph-users] (keystone + radosgw ) users

2013-07-08 Thread Yehuda Sadeh
ion: close > < Transfer-Encoding: chunked > < Content-Type: text/plain; charset=utf-8 > < > Object1 > * Closing connection #0 > > But, where is the X-Container-Read header? it should appear? Maybe the > problem is saving the metadata header > > Thanks a lo

Re: [ceph-users] (keystone + radosgw ) users

2013-07-09 Thread Yehuda Sadeh
l: martes, 09 de julio de 2013 8:55 > Para: Yehuda Sadeh > CC: ceph-users@lists.ceph.com > Asunto: Re: [ceph-users] (keystone + radosgw ) users > > The same result. > > Attached the log from creating bucket with the header 'HTTP-X-Container-Read' > > Response of

Re: [ceph-users] How to use Admin Ops API in Ceph Object Storage

2013-07-09 Thread Yehuda Sadeh
On Mon, Jul 8, 2013 at 8:51 AM, Bright wrote: > Hello Guys: > > I am working with ceph nowadys and i want to setup a system which > > includes a web page to create the ceph object storage user. > > So, i tried to use Admin Ops API to fulfill my needs. However, if i use > > GET

Re: [ceph-users] How to use Admin Ops API in Ceph Object Storage

2013-07-10 Thread Yehuda Sadeh
x27;t fail, but doesn't update the user. Right. There's the radosgw-admin caps add / rm command to do that for you. > > Many thanks and best regards, > Álvaro. > > > > -Mensaje original- > De: ceph-users-boun...@lists.ceph.com > [mailto:ceph-users-boun

Re: [ceph-users] RadosGW Logging

2013-07-10 Thread Yehuda Sadeh
On Wed, Jul 10, 2013 at 6:28 PM, Derek Yarnell wrote: > I have been running a development radosgw instance for awhile and now > looking to start a larger production one. I am trying to track down > some issues with PUT on larger files I am having from certain S3 > clients. I am running on the 0.

Re: [ceph-users] radosgw create user using API

2013-07-18 Thread Yehuda Sadeh
On Thu, Jul 18, 2013 at 12:50 AM, Alvaro Izquierdo Jimeno wrote: > Hi, > > > > Reading the URL http://ceph.com/docs/next/radosgw/adminops/#create-user , > I’m trying to create a new user with: > > > > curl -v -X PUT -d '{"uid": "alvaro", "display-name": "alvaro"} > http://myradosgw/admin/user?for

Re: [ceph-users] rgw bucket index

2013-07-22 Thread Yehuda Sadeh
On Sun, Jul 21, 2013 at 12:48 AM, Dominik Mostowiec wrote: > Hi, > Rgw bucket index is in one file (one osd performance issues). > Is there on roudmap sharding or other change to increase performance? > > Excellent question. Note that the upcoming Dupling release will have the ability to separate

Re: [ceph-users] v0.67 Dumpling released

2013-08-15 Thread Yehuda Sadeh
On Wed, Aug 14, 2013 at 8:46 PM, Jeppesen, Nelson wrote: > Sage et al, > > This is an exciting release but I must say I'm a bit confused about some of > the new rgw details. > > Questions: > > 1) I'd like to understand how regions work. I assume that's how you get > multi-site, multi-datacenter

Re: [ceph-users] radosgw creating pool with empty name after upgrade from 0.61.7 cuttlefish to 0.67 dumpling

2013-08-17 Thread Yehuda Sadeh
On Sat, Aug 17, 2013 at 6:25 AM, Øystein Lønning Nerhus wrote: > Hi, > > This seems like a bug. > > # ceph df > NAME ID USED %USED OBJECTS > .rgw.root 26 778 0 3 > .rgw 27 1118 0 8 > .r

Re: [ceph-users] failing on 0.67.1 radosgw install

2013-08-20 Thread Yehuda Sadeh
On Tue, Aug 20, 2013 at 7:34 AM, Fuchs, Andreas (SwissTXT) wrote: > Hi > > I succesfully setup a ceph cluster with 0.67.1, now I try to get the radosgw > on a separate node running > > Os=ubuntu 12.04 lts > Install seemed succesfull, but if I try to access the api I see the > following in the l

Re: [ceph-users] CORS not working

2013-08-21 Thread Yehuda Sadeh
On Wed, Aug 21, 2013 at 1:19 PM, Jeppesen, Nelson wrote: > Hello, > > I'm having issues with setting cors on dumpling. I seems like it's not doing > anything. > > I have the following CORS rule on test1 bucket: > > > > > GETPOST > http://a.a.a >

Re: [ceph-users] bucket count limit

2013-08-22 Thread Yehuda Sadeh
On Thu, Aug 22, 2013 at 7:11 AM, Dominik Mostowiec wrote: > Hi, > I think about sharding s3 buckets in CEPH cluster, create > bucket-per-XX (256 buckets) or even bucket-per-XXX (4096 buckets) > where XXX is sign from object md5 url. > Could this be the problem? (performance, or some limits) > The

Re: [ceph-users] radosgw crash

2013-08-22 Thread Yehuda Sadeh
On Thu, Aug 22, 2013 at 5:18 AM, Pawel Stefanski wrote: > hello! > > Today our radosgw crashed while running multiple deletions via s3 api. > > Is this known bug ? > > POST > WSTtobXBlBrm2r78B67LtQ== > > Thu, 22 Aug 2013 11:38:34 GMT > /inna-a/?delete >-11> 2013-08-22 13:39:26.650499 7f36347d8

Re: [ceph-users] failing on 0.67.1 radosgw install

2013-08-22 Thread Yehuda Sadeh
On Thu, Aug 22, 2013 at 12:36 AM, Fuchs, Andreas (SwissTXT) wrote: > My apache conf is as follows > > cat /etc/apache2/httpd.conf > ServerName radosgw01.swisstxt.ch > > cat /etc/apache2/sites-enabled/000_radosgw > > > ServerName *.radosgw01.swisstxt.ch > # ServerAdmin {email.addre

Re: [ceph-users] Radosgw 0.67.2 region map error

2013-08-23 Thread Yehuda Sadeh
On Fri, Aug 23, 2013 at 1:35 AM, Tobias Brunner wrote: > Hi, > > My RadosGW (0.67.2) setup keeps complaining about the following error: > > 2013-08-23 10:20:32.920808 7f9e298fb7c0 0 WARNING: cannot read region map > > # radosgw-admin region-map get > failed to read region map: (2) No such file or

Re: [ceph-users] Using radosgw with s3cmd: Bucket failure

2013-08-23 Thread Yehuda Sadeh
On Fri, Aug 23, 2013 at 1:47 AM, Tobias Brunner wrote: > Hi, > > I'm trying to use radosgw with s3cmd: > > # s3cmd ls > > # s3cmd mb s3://bucket-1 > ERROR: S3 error: 405 (MethodNotAllowed): > > So there seems to be something missing according to buckets. How can I > create buckets? What do I have

Re: [ceph-users] Object Store Multipart Upload

2013-08-23 Thread Yehuda Sadeh
I'm not aware of any multipart upload issues. Just tested it with the latest, and it seemed to work. Can you provide more details about your environment and about the failing operations? Thanks, Yehuda On Fri, Aug 23, 2013 at 8:56 AM, Juan FRANÇOIS wrote: > Hi, > > Are there any known issues for

Re: [ceph-users] Object Store Multipart Upload

2013-08-23 Thread Yehuda Sadeh
On Fri, Aug 23, 2013 at 12:47 PM, Juan FRANÇOIS wrote: > I created a server on a virtual machine for testing using Ubuntu server > (Precise 64-bit), following the 5 minute guide that used to be at > http://ceph.com/docs/master/start/quick-start/ and the radosgw one in > http://ceph.com/docs/master

Re: [ceph-users] Object Store Multipart Upload

2013-08-23 Thread Yehuda Sadeh
On Fri, Aug 23, 2013 at 2:50 PM, Yehuda Sadeh wrote: > On Fri, Aug 23, 2013 at 12:47 PM, Juan FRANÇOIS wrote: >> I created a server on a virtual machine for testing using Ubuntu server >> (Precise 64-bit), following the 5 minute guide that used to be at >> http://ceph.com/do

Re: [ceph-users] radosgw, file size limit

2013-08-24 Thread Yehuda Sadeh
On Sat, Aug 24, 2013 at 5:21 AM, Art M. wrote: > Hi guys! > Maube someone knows… > Does radosgw have file limit? > I tried to upload 7GB of data using swift with no hope. > Is it possible somehow to increase this limit? > > > For objects > 5GB you need to use the large object upload api. Swift ha

Re: [ceph-users] radosgw subusers permission problem

2013-08-26 Thread Yehuda Sadeh
On Fri, Aug 23, 2013 at 5:31 AM, Mihály Árva-Tóth wrote: > Hello, > > I have an user with 3 subuser: > > { "user_id": "johndoe", > "display_name": "John Doe", > "email": "", > "suspended": 0, > "max_buckets": 1000, > "auid": 0, > "subusers": [ > { "id": "johndoe:readonly", >

Re: [ceph-users] radosgw-admin caps

2013-08-29 Thread Yehuda Sadeh
On Thu, Aug 29, 2013 at 6:35 AM, Derek Yarnell wrote: > Hi, > > So what am I doing wrong? As I read the docs > (http://ceph.com/docs/master/radosgw/adminops/) i need users=read which > I applied with the command, > > radosgw-admin caps add --uid=derek --caps="users=read" > > But when I try to a

Re: [ceph-users] ceph s3 allowed characters

2013-08-30 Thread Yehuda Sadeh
On Fri, Aug 30, 2013 at 7:44 AM, Dominik Mostowiec wrote: > (echo -n 'GET > /dysk/files/test.test%40op.pl/DOMIWENT%202013/Damian%20DW/dw/Specyfikacja%20istotnych%20warunk%F3w%20zam%F3wienia.doc > HTTP/1.0'; printf "\r\n\r\n") | nc localhost 88 > HTTP/1.1 400 Bad Request > Date: Fri, 30 Aug 2013 1

Re: [ceph-users] Radosgw S3 - can't authenticate user

2013-09-02 Thread Yehuda Sadeh
On Mon, Sep 2, 2013 at 5:47 PM, Mark Kirkwood wrote: > I have a test setup for Radosgw on a single box. The Swift side of things > works fine, but trying S3 (via boto) I am encountering the error: > > error reading user info, uid=('X5E5BXJHCZGGII3HAWBB',) can't authenticate > > Now the access key

Re: [ceph-users] CORS not working

2013-09-03 Thread Yehuda Sadeh
On Tue, Sep 3, 2013 at 3:40 AM, Pawel Stefanski wrote: > hello! > > I've tried with wip-6078 and git dumpling builds and got the same error > during OPTIONS request. > > curl -v -X OPTIONS -H 'Access-Control-Request-Method: PUT' -H "Origin: > http://X.pl"; http://static3.X.pl/ > >> OPTIONS

Re: [ceph-users] radosgw warnings in apache error.log

2013-09-03 Thread Yehuda Sadeh
On Tue, Sep 3, 2013 at 9:13 AM, Fuchs, Andreas (SwissTXT) wrote: > We are testing radosgw with cyberduck, so far we see the following issues > > 1. In apache error log for each file put we see: > > [Tue Sep 03 17:35:24 2013] [warn] FastCGI: 193.218.104.138 PUT > https://193.218.100.131/test/tesfi

Re: [ceph-users] radosgw s3 ACLs

2013-09-03 Thread Yehuda Sadeh
On Tue, Sep 3, 2013 at 2:30 PM, Derek Yarnell wrote: > Hi, > > So say a usera has full control (and is the owner) of a bucket in s3 and > gives userb 'FULL_CONTROL' on the bucket. Userb writes a file and it > seems that by default the ACL for that key is going to be 'FULL_CONTROL' > for userb. W

Re: [ceph-users] CORS not working

2013-09-04 Thread Yehuda Sadeh
is bucket > 2013-09-04 08:07:46.083105 7ff4bf7ee700 2 req 10:0.000640:s3:OPTIONS > /:options_cors:http status=403 > 2013-09-04 08:07:46.083548 7ff4bf7ee700 1 == req done req=0xbcd910 > http_status=403 == > > best regards! > -- > pawel > > > On Tue, Sep 3,

Re: [ceph-users] Performance issues with small files

2013-09-05 Thread Yehuda Sadeh
On Thu, Sep 5, 2013 at 9:49 AM, Sage Weil wrote: > On Thu, 5 Sep 2013, Bill Omer wrote: >> Thats correct. We created 65k buckets, using two hex characters as the >> naming convention, then stored the files in each container based on their >> first two characters in the file name. The end result

Re: [ceph-users] Using radosgw with s3cmd: Bucket failure

2013-09-06 Thread Yehuda Sadeh
On Fri, Sep 6, 2013 at 3:00 AM, Georg Höllrigl wrote: > Just in case someone stumbles across the same problem: > > The option name in ceph.conf is rgw_dns_name - not as described "rgw dns > name" at http://ceph.com/docs/next/radosgw/config-ref/ !? Both should work. > > And the hostname needs to

Re: [ceph-users] CORS not working

2013-09-06 Thread Yehuda Sadeh
ated on 0.56 afair, I've tested the same operation > with fresh bucket created now on dumpling, and the problem still occurs. > > regards! > -- > pawel > > > On 04.09.2013 20:15, Yehuda Sadeh wrote: >> >> Is static3 a bucket that you created before the upgrade? Ca

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

2013-09-11 Thread Yehuda Sadeh
ool_size 200 The path to the admin socket may be different, and in any case can be set through the 'admin socket' variable in ceph.conf. Yehuda > > > 2013/9/11 Yehuda Sadeh >> >> Try modifing the 'rgw thread pool size' param in your ceph.conf. By

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

2013-09-11 Thread Yehuda Sadeh
1:/tmp# radosgw-admin -v > ceph version 0.61.8 (a6fdcca3bddbc9f177e4e2bf0d9cdd85006b028b) > > > Appreciate ~ > > > +Hugo Kuo+ > (+886) 935004793 > > > 2013/9/11 Yehuda Sadeh >> >> On Wed, Sep 11, 2013 at 7:57 AM, Kuo Hugo wrote: >> > >>

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

2013-09-11 Thread Yehuda Sadeh
OSD config information includes rgw_thread_pool_size , is > this what you mentioned ? > Why that the value is on OSD? > Where is the value of rgw_thread_pool_size that OSDs referenced from ? > The ceph global config holds that variable, the osd just gets all the defaults but it has n

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

2013-09-11 Thread Yehuda Sadeh
nchmark run for high concurrency connections > before? > > Cheers > > > +Hugo Kuo+ > (+886) 935004793 > > > 2013/9/12 Yehuda Sadeh >> >> On Wed, Sep 11, 2013 at 9:57 PM, Kuo Hugo wrote: >> > Hmm Interesting now. >> > >> > I ha

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

2013-09-11 Thread Yehuda Sadeh
On Wed, Sep 11, 2013 at 10:37 PM, Kuo Hugo wrote: > Yes. I restart it by /etc/init.d/radosgw for times before. :D > > btw, I check several things here to prevent any permission issue. > > root@p01:/var/run# /etc/init.d/radosgw start > Starting client.radosgw.gateway... > root@p01:/var/run# ps aux

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

2013-09-12 Thread Yehuda Sadeh
ests to these osds that thrash. You could try to use also the radosgw admin socket (if you manage to set it up). Yehuda > >> -Original Message- >> From: Yehuda Sadeh [mailto:yeh...@inktank.com] >> Sent: Donnerstag, 12. September 2013 06:38 >> To: Kuo Hugo >>

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

2013-09-12 Thread Yehuda Sadeh
ar/log/ceph/radosgw.log > rgw_thread_pool_size = 200 > rgw_cache_enabled = false > > > +Hugo Kuo+ > (+886) 935004793 > > > 2013/9/12 Yehuda Sadeh >> >> On Thu, Sep 12, 2013 at 4:11 AM, Fuchs, Andreas (SwissTXT) >> wrote: >> > Hi Yehuda >>

Re: [ceph-users] CORS not working

2013-09-16 Thread Yehuda Sadeh
huda > -- > pawel > > > On Fri, Sep 6, 2013 at 5:11 PM, Yehuda Sadeh wrote: >> >> Can you provide a log that includes the bucket creation, CORS settings >> and the OPTIONS call? It'd be best if you could do it with also 'debug >> ms = 1'. >&

Re: [ceph-users] CORS not working

2013-09-16 Thread Yehuda Sadeh
On Mon, Sep 16, 2013 at 9:47 AM, Pawel Stefanski wrote: > ceph version 0.67.3 (408cd61584c72c0d97b774b3d8f95c6b1b06341a) That one doesn't have the required fix, which will be in 0.67.4. Yehuda > > 16 wrz 2013 18:40, "Yehuda Sadeh" napisał(a): > >> On Mo

Re: [ceph-users] radosGW namespace

2013-09-16 Thread Yehuda Sadeh
Hi, currently different users share the same namespace. This follows the S3 semantics, and allows accessing buckets directly via a virtual host name. We do have multiple namespaces in mind though, and I also prototyped it not too long ago: http://wiki.ceph.com/01Planning/02Blueprints/Emperor/rg

Re: [ceph-users] CORS not working

2013-09-16 Thread Yehuda Sadeh
with Ceph -v. > static33 bucket was made on 0.67. > > best regards! > > > On Mon, Sep 16, 2013 at 5:46 PM, Yehuda Sadeh wrote: >> >> On Mon, Sep 16, 2013 at 3:46 AM, Pawel Stefanski >> wrote: >> > hello all! >> > >> > Once again sorry

Re: [ceph-users] radosgw bucket question

2013-09-16 Thread Yehuda Sadeh
On Mon, Sep 16, 2013 at 7:21 PM, 鹏 wrote: > > > hi > So what am I doing wrong? when i run commond: > radosgw-admin bucket list --uid=johdone the return is [] > and the commond > radosgw-admin bucket list --uid=wkp4666 the return is [] > and the commond > radosgw-admin bucket listthe retu

Re: [ceph-users] Help with radosGW

2013-09-17 Thread Yehuda Sadeh
On Tue, Sep 17, 2013 at 1:29 AM, Alexis GÜNST HORN wrote: > Hello to all, > > I've a big issue with Ceph RadosGW. > I did a PoC some days ago with radosgw. It worked well. > > Ceph version 0.67.3 under CentOS 6.4 > > Now, I'm installing a new cluster but, I can't succeed. I do not understand > wh

Re: [ceph-users] Uploading large files to swift interface on radosgw

2013-09-17 Thread Yehuda Sadeh
On Tue, Sep 17, 2013 at 3:21 PM, Gerd Jakobovitsch wrote: > Hi all, > > I am testing a ceph environment installed in debian wheezy, and, when > testing file upload of more than 1 GB, I am getting errors. For files larger > than 5 GB, I get a "400 Bad Request EntityTooLarge" response; looking at

Re: [ceph-users] Uploading large files to swift interface on radosgw

2013-09-19 Thread Yehuda Sadeh
bovitsch wrote: > > Hello Yehuda, thank you for your help. > > > On 09/17/2013 08:35 PM, Yehuda Sadeh wrote: >> >> On Tue, Sep 17, 2013 at 3:21 PM, Gerd Jakobovitsch >> wrote: >>> >>> Hi all, >>> >>> I am testing a ceph environ

Re: [ceph-users] poor radosgw performance

2013-09-19 Thread Yehuda Sadeh
On Thu, Sep 19, 2013 at 8:52 AM, Matt Thompson wrote: > Hi All, > > We're trying to test swift API performance of swift itself (1.9.0) and > ceph's radosgw (0.67.3) using the following hardware configuration: > > Shared servers: > > * 1 server running keystone for authentication > * 1 server runni

Re: [ceph-users] poor radosgw performance

2013-09-20 Thread Yehuda Sadeh
missing something). That looks like a ceph generic directory that can be used to put your specific user's keyring file (but I might be wrong). > > Thanks again for the help! > > -Matt > > > > On Thu, Sep 19, 2013 at 5:01 PM, Yehuda Sadeh wrote: >> >> On Thu

Re: [ceph-users] Keystone + RadosGW Authentication

2013-09-20 Thread Yehuda Sadeh
On Fri, Sep 20, 2013 at 4:03 AM, Rick Stokkingreef wrote: > Hello, > > I'm trying to connect radosgw to keystone, it seems it is all working but it > won't create the bucket: > > > Error Swift Client: > DEBUG:root:HTTP PERF: 0.05760 seconds to PUT 10.10.10.51:80 /swift/v1/test) > DEBUG:swiftclient

Re: [ceph-users] poor radosgw performance

2013-09-20 Thread Yehuda Sadeh
"? If so, we > don't have that set in our ceph.conf so should in theory be using it already. I actually meant to say ceph authentication, not ceph cache. Yehuda > > > > On Fri, Sep 20, 2013 at 3:57 PM, Yehuda Sadeh wrote: >> >> On Fri, Sep 20, 2013 at 3:51

Re: [ceph-users] how to use admin api to trim_usage.

2013-09-21 Thread Yehuda Sadeh
On Sat, Sep 21, 2013 at 7:08 PM, 鹏 wrote: > hi: > I follow the docment > http://ceph.com/docs/master/radosgw/adminops/#trim-usage send > > DELETE /{admin}/usage?format=json HTTP/1.1 > but the rwsquest is 400 {"Code":"InvalidArgument"} > > the log is > > > compare=0 > DELETE /admin/usage:t

Re: [ceph-users] how to install radosgw from source code?

2013-09-23 Thread Yehuda Sadeh
On Mon, Sep 23, 2013 at 1:18 AM, yy-nm wrote: > hay, folks: > i use ceph source code to install a ceph cluster. ceph version 0.61.8 > (a6fdcca3bddbc9f177e4e2bf0d9cdd85006b028b) > After finish install, i can't find radosgw command? > i use below paramter in ceph's installation: > > install pack

Re: [ceph-users] Ceph / RadosGW deployment questions

2013-09-24 Thread Yehuda Sadeh
On Tue, Sep 24, 2013 at 12:46 AM, Guang wrote: > Hi ceph-users, > I deployed a Ceph cluster (including RadosGW) with use of ceph-deploy on > RHEL6.4, during the deployment, I have a couple of questions which need your > help. > > 1. I followed the steps http://ceph.com/docs/master/install/rpm/ to

Re: [ceph-users] radosgw-admin unable to list or store user info after upgrade

2013-09-26 Thread Yehuda Sadeh
On Thu, Sep 26, 2013 at 7:42 AM, Mike O'Toole wrote: > After upgrading from Cuddlefish to Dumpling I am no longer able to obtain > user information from the rados gateway. > > radosgw-admin user info > could not fetch user info: no user info saved > > > radosgw-admin user create --uid=bob --displa

Re: [ceph-users] radosgw-admin unable to list or store user info after upgrade

2013-09-26 Thread Yehuda Sadeh
Are you sure you ran the same radosgw-admin command? the log shows a different error message. Can you re-run it with also (besides the --debug-ms=1 and --debug-rgw=20) also with --debug-objecter=20? On Thu, Sep 26, 2013 at 9:09 AM, Mike O'Toole wrote: > radosgw-admin zone get > { "domain_root": "

Re: [ceph-users] radosgw-admin unable to list or store user info after upgrade

2013-09-26 Thread Yehuda Sadeh
The osd returns some unexpected error: 2013-09-26 13:25:17.651552 7ff13cd0b700 1 -- 10.10.2.55:0/1005496 <== osd.2 10.10.2.200:6800/4790 5 osd_op_reply(25 bob [call,getxattrs,stat] ack = -5 (Input/output error)) v4 186+0+0 (4137529543 0 0) 0x7ff120002490 con 0xa6a380 Is there a matchin

Re: [ceph-users] Scaling radosgw module

2013-09-26 Thread Yehuda Sadeh
You specify the relative performance, but what the actual numbers that you're seeing? How many GETs per second, and how many PUTs per second do you see? On Thu, Sep 26, 2013 at 4:00 PM, Somnath Roy wrote: > Mark, > One more thing, all my test is with rgw cache enabled , disabling the cache > the

Re: [ceph-users] failure starting radosgw after setting up object storage

2013-09-27 Thread Yehuda Sadeh
On Wed, Sep 25, 2013 at 2:07 PM, Gruher, Joseph R wrote: > Hi all- > > > > I am following the object storage quick start guide. I have a cluster with > two OSDs and have followed the steps on both. Both are failing to start > radosgw but each in a different manner. All the previous steps in the

Re: [ceph-users] gateway instance

2013-09-27 Thread Yehuda Sadeh
On Fri, Sep 27, 2013 at 1:10 AM, lixuehui wrote: > Hi all > Does gateway instances mean multi-process of a gateway user for a ceph > cluster. Though they were configured independently during the configure > file,can they configured with zones among different region? Not sure I follow your questi

Re: [ceph-users] radosgw-admin show all users

2013-09-30 Thread Yehuda Sadeh
On Mon, Sep 30, 2013 at 10:57 AM, Jefferson Alcantara wrote: > hi , > > > I need help for show all users created on radosgw-admin all users using > buckets or not ,I dont find any attribute for show this , I tried > radosgw-admin user info -iud=* but this options does not accept query , > anyb

Re: [ceph-users] sudo radosgw-admin subuser create

2013-10-08 Thread Yehuda Sadeh
On Tue, Oct 8, 2013 at 8:21 AM, wrote: > Ok, > > > > Think I spotted the issue. I think the guide has the subuser credentials > which map to the swift tenant:user in the wrong order. > > > > Guide states: > > sudo radosgw-admin subuser create --uid=johndoe --subuser=johndoe:swift > --access=full

Re: [ceph-users] WARNING: read region map

2013-10-10 Thread Yehuda Sadeh
The region map has not been initialized. Try running: $ radosgw-admin region-map update Yehuda On Thu, Oct 10, 2013 at 4:34 PM, Jefferson Alcantara wrote: > hi , > > > I need help , when I try run radosgw-admin metadata list I `m receive the > mensage 0 WARNING: cannot read region mapanyb

Re: [ceph-users] error radosgw service

2013-10-10 Thread Yehuda Sadeh
On Thu, Oct 10, 2013 at 4:38 PM, Jefferson Alcantara wrote: > I need help for my radosgw machine , when I try start the service radosgw I > receive equal bellow : > > /etc/init.d/radosgw start > Starting client.radosgw.napsao-nix-qa-ceph-s301... > 2013-10-10 20:34:14.047159 7f5dfc20b780 -1 WARNI

Re: [ceph-users] radosgw-admin doesn't list user anymore

2013-10-11 Thread Yehuda Sadeh
On Fri, Oct 11, 2013 at 7:46 AM, Valery Tschopp wrote: > Hi, > > Since we upgraded ceph to 0.67.4, the radosgw-admin doesn't list all the > users anymore: > > root@ineri:~# radosgw-admin user info > could not fetch user info: no user info saved > > > But it still work for single user: > > root@ine

Re: [ceph-users] radosgw-admin object unlink

2013-10-12 Thread Yehuda Sadeh
On Sat, Oct 12, 2013 at 4:00 PM, Dominik Mostowiec wrote: > Hi, > How works radosgw-admin object unlink? > > After: > radosgw-admin object unlink --bucket=testbucket 'test_file_1001.txt' Try: $ radosgw-admin object unlink --bucket=testbucket --object='test_file_1001.txt' Yehuda > > File stil

Re: [ceph-users] radosgw-admin object unlink

2013-10-13 Thread Yehuda Sadeh
(not mark it as removed)? > > -- > Regards > Domink > > 2013/10/13 Yehuda Sadeh : >> On Sat, Oct 12, 2013 at 4:00 PM, Dominik Mostowiec >> wrote: >>> Hi, >>> How works radosgw-admin object unlink? >>> >>> After: >>> radosgw-admin ob

Re: [ceph-users] radosgw can still get the object even if this object's physical file is removed on OSDs

2013-10-14 Thread Yehuda Sadeh
On Mon, Oct 14, 2013 at 4:04 AM, david zhang wrote: > Hi ceph-users, > > I uploaded an object successfully to radosgw with 3 replicas. And I located > all the physical paths of 3 replicas on different OSDs. > > i.e, one of the 3 physical paths is > /var/lib/ceph/osd/ceph-2/current/3.5_head/DIR_D/d

Re: [ceph-users] Ceph, Keystone and S3

2013-10-15 Thread Yehuda Sadeh
On Tue, Oct 15, 2013 at 7:17 AM, Carlos Gimeno Yañez wrote: > Hi > > I've deployed Ceph using Ceph-deploy and following the official > documentation. I've created a user to use with Swift and everything is > working fine, my users can create buckets and upload files if they use > Horizon Dashboard

Re: [ceph-users] Radosgw usage

2013-10-21 Thread Yehuda Sadeh
On Sun, Oct 20, 2013 at 9:04 PM, Derek Yarnell wrote: > So I have tried to enable usage logging on a new production Ceph RadosGW > cluster but nothing seems to show up. > > I have added to the [client.radosgw.] section the following > > rgw enable usage log = true > rgw usage log tick interval = 3

Re: [ceph-users] error: failed to add bucket placement

2013-10-21 Thread Yehuda Sadeh
On Mon, Oct 21, 2013 at 2:46 PM, Snider, Tim wrote: > > Can someone tell me what I'm missing. I have a radosgw user created. > > I get the following complaint when I try to create a pool with or without the > --uid parameter: > > > #radosgw-admin pool add --pool=radosPool --uid=rados > > failed t

Re: [ceph-users] radosgw-admin object unlink

2013-10-26 Thread Yehuda Sadeh
t in bucket without rgw index)? > > -- > Regards > Dominik > > 2013/10/13 Dominik Mostowiec : >> hmm, 'tail' - do you mean file/object content? >> I thought that this command might be workaround for 'blind bucket'. >> Am I wrong? >> >> -

Re: [ceph-users] "set_req_state_err err_no=27 resorting to 500" with multipart large file upload

2013-10-28 Thread Yehuda Sadeh
On Mon, Oct 28, 2013 at 9:24 AM, Wido den Hollander wrote: > Hi, > > I'm testing with some multipart uploads to RGW and I'm hitting a problem > when trying to upload files larger then 1159MB. > > The tool I'm using is s3cmd 1.5.1 > > Ceph version: 0.67.4 > > It's very specific, this is what I trie

Re: [ceph-users] Scaling radosgw module

2013-10-28 Thread Yehuda Sadeh
Sounds like an issue with your apache config. How did you install your apache? What distribution are you running on? Are you using it as mpm-worker? Do you have non-default radosgw settings? Yehuda On Mon, Oct 28, 2013 at 11:58 AM, hadi golestani wrote: > My test is so simple, > On a cluster wit

Re: [ceph-users] Radosgw partial gc

2013-10-28 Thread Yehuda Sadeh
On Mon, Oct 28, 2013 at 9:06 PM, Mark Kirkwood wrote: > I have a radosgw instance (ceph 0.71-299-g5cba838 src build), running on > Ubuntu 13.10. I've been experimenting with multipart uploads (which are > working fine). However while *most* objects (from radosgw perspective) have > their storage s

Re: [ceph-users] rgw bucket creation fails

2013-11-04 Thread Yehuda Sadeh
On Mon, Nov 4, 2013 at 6:40 AM, Corin Langosch wrote: > Hi, > > using ceph 0.67.4 I followed http://ceph.com/docs/master/radosgw/. I can > connect using s3cmd (test configuration succeeds), so the user credentials > and everything else seems to be running as it should. But when doing a > "s3cmd mb

Re: [ceph-users] radosgw fails to start

2013-11-04 Thread Yehuda Sadeh
Not sure why you're able to run the 'rados' and 'ceph' command, and not 'radosgw', just note that the former two don't connect to the osds, whereas the latter does, so it might fail on a different level. You're using the default client.admin as the user for radosgw, but your ceph.conf file doesn't

Re: [ceph-users] radosgw fails to start

2013-11-04 Thread Yehuda Sadeh
On Mon, Nov 4, 2013 at 1:12 PM, Gruher, Joseph R wrote: >>-Original Message- >>From: Yehuda Sadeh [mailto:yeh...@inktank.com] >>Sent: Monday, November 04, 2013 12:40 PM >>To: Gruher, Joseph R >>Cc: ceph-users@lists.ceph.com >>Subject: Re: [ceph-users]

Re: [ceph-users] can not create bucket

2013-11-04 Thread Yehuda Sadeh
error 95 is "Not supported", might mean that there are some issues with the osd, e.g., incompatibility (running older version than the gateway's), or likely objclass issues. What does the osd log say? Yehuda On Mon, Nov 4, 2013 at 6:50 PM, 鹏 wrote: > > hi all! > I configuration a ceph obje

Re: [ceph-users] s3 user can't create bucket

2013-11-06 Thread Yehuda Sadeh
On Tue, Nov 5, 2013 at 11:28 PM, lixuehui wrote: > Hi all: > > I failed to create bucket with s3 API. the error is 403 'Access Denied'.In > fact ,I've give the user write permission. > { "user_id": "lxh", > "display_name": "=lxh", > "email": "", > "suspended": 0, > "max_buckets": 1000, >

Re: [ceph-users] How to use Admin Ops API in Ceph Object Storage

2013-11-07 Thread Yehuda Sadeh
You can do it through the metadata api. Try doing something like: GET /admin/metadata/user Yehuda On Thu, Nov 7, 2013 at 12:06 PM, Nelson Jeppesen wrote: > I've looked around but could not find it. Can I open a ticket for this > issue? > > Not being able to enumerate users via API is a road blo

  1   2   3   4   5   6   >