Re: [ceph-users] More than one rados gateway per ceph cluster?

2013-03-22 Thread Yehuda Sadeh
On Fri, Mar 22, 2013 at 10:13 AM, Jeppesen, Nelson wrote: > Is it possible to have two independent rados gw farms in one Ceph > environment? > > I can't figure out how to get two rados gateway servers use different pools. > Basically I want two rados gateway farms (internal, external) that's ho

Re: [ceph-users] More than one rados gateway per ceph cluster?

2013-03-22 Thread Yehuda Sadeh
og_pool": ".usage", "user_keys_pool": ".users", "user_email_pool": ".users.email", "user_swift_pool": ".users.swift", "user_uid_pool ": ".users.uid"} On Fri, Mar 22, 2013 at 12:15 PM, Jeppesen, Nelson w

Re: [ceph-users] RadosGW fault tolerance

2013-03-24 Thread Yehuda Sadeh
On Sun, Mar 24, 2013 at 7:14 PM, Rustam Aliyev wrote: > Hi, > > I was testing RadosGW setup and observed strange behavior - RGW becomes > unresponsive or won't start whenever cluster health is degraded (e.g. > restarting one of the OSDs). Probably I'm doing something wrong but I > couldn't find an

Re: [ceph-users] Fixing a rgw bucket index

2013-04-08 Thread Yehuda Sadeh
We'll need to have more info about the current state. Was just the omap header destroyed, or does it still exist? What does the header contain now? Are you able to actually access objects in that bucket, but just fail to list them? On Mon, Apr 8, 2013 at 8:34 AM, Erdem Agaoglu wrote: > Hi again,

Re: [ceph-users] Fixing a rgw bucket index

2013-04-08 Thread Yehuda Sadeh
usage": { "rgw.main": { "size_kb": 6000607, > "size_kb_actual": 6258740, > "num_objects": 128443}}}, > "calculated_header": { "usage": { "rgw.main": { "size_kb": 6000607, &g

Re: [ceph-users] Fixing a rgw bucket index

2013-04-08 Thread Yehuda Sadeh
odd besides that. > http://pastebin.com/xWCYmnXV > > Thanks for your interest. > > > On Mon, Apr 8, 2013 at 8:21 PM, Yehuda Sadeh wrote: >> >> Each bucket has a unique prefix which you can get by doing radosgw-admin >> bucket stats on that bucket. You can g

Re: [ceph-users] radosgw: set_contents_from_string provokes "Internal Server Error"

2013-04-11 Thread Yehuda Sadeh
On Thu, Apr 11, 2013 at 5:53 AM, Arne Wiebalck wrote: > Hi, > > We see a reproducible "Internal Server Error" when doing something like > > --> > #!/usr/bin/env python > > import boto > import boto.s3.connection > access_key = '...' > secret_key = '...' > > conn = boto.connect_s3( > aws_ac

Re: [ceph-users] time zone in rados-admin and usage logs

2013-04-17 Thread Yehuda Sadeh
On Wed, Apr 17, 2013 at 6:22 AM, Pawel Stefanski wrote: > hello! > > I have one small question - time localized in what timezone should I use > with radosgw-admin tool ? > > I'm grabbing usage logs, for a hour ago, and I'm trying to set start and end > dates in GMT, I've tried also with local date

Re: [ceph-users] spontaneous pg inconstancies in the rgw.gc pool

2013-04-18 Thread Yehuda Sadeh
On Thu, Apr 18, 2013 at 7:57 AM, Dan van der Ster wrote: > > Sorry for the noise.. we now have a better idea what happened here. > > For those that might care, basically we had one client looping while > trying to list the / bucket with an incorrect key. rgw was handling > this at 1kHz, so congrat

Re: [ceph-users] RadosGW and S3-compatible clients for PC and OSX

2013-04-21 Thread Yehuda Sadeh
On Sun, Apr 21, 2013 at 3:02 AM, Igor Laskovy wrote: > A little bit more. > > I have tried deploy RGW via http://ceph.com/docs/master/radosgw/ and than > connect S3 Browser, CrossFTP and CloudBerry Explorer clients, but all > unsuccessfully. > > Again my question, does anybody use S3 desktop clien

Re: [ceph-users] RadosGW and S3-compatible clients for PC and OSX

2013-04-21 Thread Yehuda Sadeh
ke that? > > > On Sun, Apr 21, 2013 at 6:53 PM, Yehuda Sadeh wrote: >> >> On Sun, Apr 21, 2013 at 3:02 AM, Igor Laskovy >> wrote: >> > A little bit more. >> > >> > I have tried deploy RGW via http://ceph.com/docs/master/radosgw/ and &

Re: [ceph-users] RadosGW and S3-compatible clients for PC and OSX

2013-04-21 Thread Yehuda Sadeh
request \x16\x03\x01 > [Sun Apr 21 19:56:25 2013] [error] [client 192.168.1.51] Invalid method in > request \x16\x03\x01 > [Sun Apr 21 19:56:25 2013] [error] [client 192.168.1.51] Invalid method in > request \x16\x03\x01 > > tail -f /var/log/apache2/access.log > nothing >

Re: [ceph-users] Radosgw using s3 copy corrupt files

2013-04-22 Thread Yehuda Sadeh
On Mon, Apr 22, 2013 at 1:03 AM, Yann ROBIN wrote: > Hi, > > > > We use radosgw and s3 API and we recently needed to update metadata on some > files. > > So we used the copy part of the S3 API for an in place replacement of the > file adding some meta. > > > > We quickly saw some very high respons

Re: [ceph-users] Rados Gateway Pools

2013-04-22 Thread Yehuda Sadeh
On Mon, Apr 22, 2013 at 9:42 AM, John Nielsen wrote: > On Mar 15, 2013, at 8:15 PM, Yehuda Sadeh wrote: > >> On Fri, Mar 15, 2013 at 5:06 PM, Mandell Degerness >> wrote: >>> How are the pools used by rgw defined? >>> >>> Specifically, if I want

Re: [ceph-users] Radosgw using s3 copy corrupt files

2013-04-22 Thread Yehuda Sadeh
.WithSourceBucket(HtmlBucket) > .WithDestinationKey(key) > .WithDestinationBucket(HtmlBucket) > .WithMetaData(MetaHtmlLocations, metaLocation); > > -- > Yann > > -Original Message- > From: Yehuda Sadeh [mailto:yeh...@inktan

Re: [ceph-users] RadosGW and S3-compatible clients for PC and OSX

2013-04-23 Thread Yehuda Sadeh
resting thing to look at it right now. The docs might be a bit unclear, we've seen some error there recently, can you make sure that there's only a single VirtualHost section in it? > > > On Sun, Apr 21, 2013 at 11:49 PM, Yehuda Sadeh wrote: >> >> On Sun, Apr 21, 20

Re: [ceph-users] RadosGW and S3-compatible clients for PC and OSX

2013-04-23 Thread Yehuda Sadeh
Order allow,deny > Allow from all > AuthBasicAuthoritative Off > > > > AllowEncodedSlashes On > ErrorLog /var/log/apache2/error.log > CustomLog /var/log/apache2/access.log combined >

Re: [ceph-users] Problem with "radosgw-admin temp remove"

2013-04-27 Thread Yehuda Sadeh
The temp remove is an obsolete feature that was needed before the introduction of the garbage collector. It's not needed in that version. Yehuda On Sat, Apr 27, 2013 at 6:33 AM, Igor Laskovy wrote: > Hello, > > have problem with clearing space for RGW pool with "radosgw-admin temp > remove" comm

Re: [ceph-users] Problem with "radosgw-admin temp remove"

2013-04-27 Thread Yehuda Sadeh
huda, explain please a little bit more about how I can control this > behavior ? > > On Sat, Apr 27, 2013 at 7:09 PM, Igor Laskovy wrote: >> Well, than what about used space of RGW pool? How I can trim it after >> files deletion? >> >> On Sat, Apr 27, 2013 at

Re: [ceph-users] Backporting the kernel client

2013-04-29 Thread Yehuda Sadeh
On Mon, Apr 29, 2013 at 6:16 AM, Juha Aatrokoski wrote: > I'm probably not the only one who would like to run a distribution-provided > kernel (which for Debian Wheezy/Ubuntu Precise is 3.2) and still have a > recent-enough Ceph kernel client. So I'm wondering whether it's feasible to > backport t

Re: [ceph-users] Why would you update 'rgw usage max user shards' setting?

2013-05-01 Thread Yehuda Sadeh
On Wed, May 1, 2013 at 9:29 AM, Jeppesen, Nelson wrote: > Why would you update 'rgw usage max user shards' setting? I don’t really > understand what it’s for. Thank you. This param specifies the number of objects the usage data is being written to. A higher number means that load spreads across,

Re: [ceph-users] Rados Gateway Pools

2013-05-07 Thread Yehuda Sadeh
On Tue, May 7, 2013 at 2:26 PM, Jeppesen, Nelson wrote: > Now the .61 is out I have tried getting a second radosgw farm working but > into an issue using a custom root/zone pool. > > > > The ‘radosgw-admin zone set’ and ‘ radosgw-admin zone info’ commands are > working fine except it keeps defaul

Re: [ceph-users] Rados Gateway Pools

2013-05-07 Thread Yehuda Sadeh
l2", "user_swift_pool": ".users.swift2", "user_uid_pool ": ".users.uid2"} Can you make sure you're running the correct version? > > Neither is reading from .rgw.zone2. How do you get radosgw-admin to run as a > different user? > $ radosgw

Re: [ceph-users] e release

2013-05-10 Thread Yehuda Sadeh
On Fri, May 10, 2013 at 11:31 AM, Sage Weil wrote: > We need a cephalopod name that starts with 'e', and trolling through > taxonomies seems like a great thing to crowdsource. :) So far I've found > a few latin names, but the main problem is that I can't find a single > large list of species wit

Re: [ceph-users] Unable to get RadosGW working on CentOS 6

2013-05-13 Thread Yehuda Sadeh
On Mon, May 13, 2013 at 7:01 PM, Jeff Bachtel wrote: > Environment is CentOS 6.4, Apache, mod_fastcgi (from repoforge, so probably > without the continue 100 patches). I'm attempting to install radosgw on the > 2nd mon host. > > My setup consistently fails when running s3test.py from > http://wiki

Re: [ceph-users] Noobish questions on the radosgw and keystone

2013-05-15 Thread Yehuda Sadeh
On Wed, May 15, 2013 at 6:45 AM, Davide Fanciola wrote: > Hello everyone, > > i'm trying to setup the radosgw with keystone integration and having a few > problems, hopefully due to my noobism. > I'm using Ubuntu 13.04 with ceph-0.61.2-1raring and > keystone-2013.1-0ubuntu1. > > I followed the doc

Re: [ceph-users] Doubts about RadosGW and Metadata

2013-05-28 Thread Yehuda Sadeh
On Tue, May 28, 2013 at 1:12 AM, Wido den Hollander wrote: > Hi, > > > On 05/28/2013 10:03 AM, Alvaro Izquierdo Jimeno wrote: >> >> Hi! >> >> I’m using rados Gateway with the Swift API to handle objects into Ceph. >> I’m very interesting to handle metadata with the objects too. So, I can >> add me

Re: [ceph-users] Debugging radosgw/keystone packet signing issue

2013-05-28 Thread Yehuda Sadeh
It might be that it's missing another certificate (for the CA). Under /etc/keystone/ssl there are a bunch of other certificates, maybe the instructions are missing one of these. Yehuda On Tue, May 28, 2013 at 2:40 AM, Davide Fanciola wrote: > Hi all, > > > > I’m trying to debug a problem with pa

Re: [ceph-users] Debugging radosgw/keystone packet signing issue

2013-05-28 Thread Yehuda Sadeh
On Tue, May 28, 2013 at 8:25 AM, Davide Fanciola wrote: > Hi Yehuda, > > I finally managed to make it work :) Awesome! > > The certificates were correct but the trust options for the "signing_cert" > were not. > The command I used to convert the signing_cert is the following : > > # openssl x509

Re: [ceph-users] Having trouble using CORS in radosgw

2013-06-06 Thread Yehuda Sadeh
Are you trying to set the CORS header using a user other than the user who created the bucket? Yehuda On Wed, Jun 5, 2013 at 8:25 AM, Mike Bryant wrote: > Hi, > I'm having trouble setting a CORS policy on a bucket. > Using the boto python library, I can create a bucket and so on, but > when I tr

Re: [ceph-users] Having trouble using CORS in radosgw

2013-06-06 Thread Yehuda Sadeh
g the same credentials. > i.e. using boto, bucket = boto.create_bucket(...), followed by, > bucket.set_cors(). > > Mike > > On 6 June 2013 15:51, Yehuda Sadeh wrote: > > Are you trying to set the CORS header using a user other than the user > > who created the bucket? &

Re: [ceph-users] Having trouble using CORS in radosgw

2013-06-06 Thread Yehuda Sadeh
it works for you, so that we can adjust it. Thanks On Thu, Jun 6, 2013 at 8:39 AM, Mike Bryant wrote: > I did, and I do. (Well, having just tried it again under debug mode) > http://pastebin.com/sRHWR6Rh > > On 6 June 2013 16:15, Yehuda Sadeh wrote: >> I guess you run set_cors() w

Re: [ceph-users] Having trouble using CORS in radosgw

2013-06-06 Thread Yehuda Sadeh
Yes, that change lets me get and set cors policies as I would expect. > > Thanks, > Mike > > On 6 June 2013 17:45, Yehuda Sadeh wrote: >> Looking at it, it fails in a much basic level than I expected. My >> guess off the cuff is that the 'cors' sub-resource

Re: [ceph-users] minimal ceph permissions for rados gateway

2013-06-12 Thread Yehuda Sadeh
On Wed, Jun 12, 2013 at 12:59 PM, John Nielsen wrote: > After updating to Cuttlefish I was able to set up two rados gateways using > distinct pools and users. (Thanks Yehuda!) Now I'd like to make it so the > user for each gateway can only access its own pools and nothing else. The > reasons in

Re: [ceph-users] minimal ceph permissions for rados gateway

2013-06-12 Thread Yehuda Sadeh
On Wed, Jun 12, 2013 at 1:48 PM, John Nielsen wrote: > On Jun 12, 2013, at 2:02 PM, Yehuda Sadeh wrote: > >> On Wed, Jun 12, 2013 at 12:59 PM, John Nielsen wrote: >>> After updating to Cuttlefish I was able to set up two rados gateways using >>> distinct pools a

Re: [ceph-users] minimal ceph permissions for rados gateway

2013-06-12 Thread Yehuda Sadeh
On Wed, Jun 12, 2013 at 2:43 PM, John Nielsen wrote: > On Jun 12, 2013, at 2:51 PM, Yehuda Sadeh wrote: > >> On Wed, Jun 12, 2013 at 1:48 PM, John Nielsen wrote: >>> On Jun 12, 2013, at 2:02 PM, Yehuda Sadeh wrote: >>> >>>> On Wed, Jun 12, 2013 at

Re: [ceph-users] minimal ceph permissions for rados gateway

2013-06-13 Thread Yehuda Sadeh
On Thu, Jun 13, 2013 at 3:01 PM, John Nielsen wrote: > On Jun 12, 2013, at 8:15 PM, Yehuda Sadeh wrote: > >> On Wed, Jun 12, 2013 at 2:43 PM, John Nielsen wrote: >>> On Jun 12, 2013, at 2:51 PM, Yehuda Sadeh wrote: >>> >>>> On Wed, Jun 12, 2013 at 1:4

Re: [ceph-users] ceph + openstack integration

2013-06-28 Thread Yehuda Sadeh
On Fri, Jun 28, 2013 at 1:11 AM, Vadim Izvekov wrote: > Hello! > > > We got a issue with integration of RadosGW and Keystone. Can you support us? > > We have such ceph configuration: > > [global] > > rgw socket path = /tmp/radosgw.sock > > [client.radosgw.gateway] > host = fuel-contr

Re: [ceph-users] (keystone + radosgw ) users

2013-07-04 Thread Yehuda Sadeh
The rados gateway supports swift form of ACLs on buckets in which it is possible to set read/write permissions for each bucket to allow access for its objects. This can be done by setting the X-Container-Read, and X-Container-Write attributes on the containers. Each attribute is a comma delimited l

Re: [ceph-users] RGW put file question

2015-02-12 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: baijia...@126.com > To: "ceph-users" > Sent: Wednesday, February 4, 2015 5:47:03 PM > Subject: [ceph-users] RGW put file question > > when I put file failed, and run the function " > RGWRados::cls_obj_complete_cancel", > why we use CLS_RGW_OP_ADD not use CLS

Re: [ceph-users] Having problem to start Radosgw

2015-02-14 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "B L" > To: ceph-users@lists.ceph.com > Sent: Friday, February 13, 2015 11:55:22 PM > Subject: [ceph-users] Having problem to start Radosgw > > Hi all, > > I’m having a problem to start radosgw, giving me error that I can’t diagnose: > > $ radosgw -c ceph.

Re: [ceph-users] Having problem to start Radosgw

2015-02-14 Thread Yehuda Sadeh-Weinraub
ehuda - Original Message - > From: "B L" > To: "Yehuda Sadeh-Weinraub" > Cc: ceph-users@lists.ceph.com > Sent: Saturday, February 14, 2015 8:32:52 AM > Subject: Re: [ceph-users] Having problem to start Radosgw > > Hello Yehuda, > > Thanks for your

Re: [ceph-users] Having problem to start Radosgw

2015-02-14 Thread Yehuda Sadeh-Weinraub
No, something like this: sudo strace -F -T -tt -o/tmp/strace.out radosgw -c ceph.conf -f - Original Message - > From: "B L" > To: "Yehuda Sadeh-Weinraub" > Cc: ceph-users@lists.ceph.com > Sent: Saturday, February 14, 2015 9:01:09 AM > Subject:

Re: [ceph-users] Having problem to start Radosgw

2015-02-14 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "B L" > To: "Yehuda Sadeh-Weinraub" > Cc: ceph-users@lists.ceph.com > Sent: Saturday, February 14, 2015 11:03:42 AM > Subject: Re: [ceph-users] Having problem to start Radosgw > Hello Yehyda, > The strace comman

Re: [ceph-users] Having problem to start Radosgw

2015-02-14 Thread Yehuda Sadeh-Weinraub
add the '-n client.radosgw.gateway' param when you're running the gateway, all your settings are under that user. Yehuda - Original Message - > From: "B L" > To: "Yehuda Sadeh-Weinraub" > Cc: ceph-users@lists.ceph.com > Sent: Satur

Re: [ceph-users] RadosGW - multiple dns names

2015-02-23 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Shinji Nakamoto" > To: ceph-us...@ceph.com > Sent: Friday, February 20, 2015 3:58:39 PM > Subject: [ceph-users] RadosGW - multiple dns names > We have multiple interfaces on our Rados gateway node, each of which is > assigned to one of our many VLANs with a

Re: [ceph-users] mixed ceph versions

2015-02-25 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Gregory Farnum" > To: "Tom Deneau" > Cc: ceph-users@lists.ceph.com > Sent: Wednesday, February 25, 2015 3:20:07 PM > Subject: Re: [ceph-users] mixed ceph versions > > On Wed, Feb 25, 2015 at 3:11 PM, Deneau, Tom wrote: > > I need to set up a cluster where

Re: [ceph-users] RadosGW S3ResponseError: 405 Method Not Allowed

2015-02-27 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Steffen W Sørensen" > To: ceph-users@lists.ceph.com > Sent: Friday, February 27, 2015 6:40:01 AM > Subject: [ceph-users] RadosGW S3ResponseError: 405 Method Not Allowed > > Hi, > > Newbie to RadosGW+Ceph, but learning... > Got a running Ceph Cluster workin

Re: [ceph-users] RadosGW S3ResponseError: 405 Method Not Allowed

2015-02-27 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Steffen W Sørensen" > To: "Yehuda Sadeh-Weinraub" > Cc: ceph-users@lists.ceph.com > Sent: Friday, February 27, 2015 9:39:46 AM > Subject: Re: [ceph-users] RadosGW S3ResponseError: 405 Method Not Allowed > On 27/02

Re: [ceph-users] Hammer sharded radosgw bucket indexes question

2015-03-04 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Ben Hines" > To: "ceph-users" > Sent: Wednesday, March 4, 2015 1:03:16 PM > Subject: [ceph-users] Hammer sharded radosgw bucket indexes question > > Hi, > > These questions were asked previously but perhaps lost: > > We have some large buckets. > > - Wh

Re: [ceph-users] Understand RadosGW logs

2015-03-05 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Daniel Schneller" > To: ceph-users@lists.ceph.com > Sent: Tuesday, March 3, 2015 2:54:13 AM > Subject: [ceph-users] Understand RadosGW logs > > Hi! > > After realizing the problem with log rotation (see > http://thread.gmane.org/gmane.comp.file-systems.cep

Re: [ceph-users] rgw admin api - users

2015-03-05 Thread Yehuda Sadeh-Weinraub
The metadata api can do it: GET /admin/metadata/user Yehuda - Original Message - > From: "Joshua Weaver" > To: ceph-us...@ceph.com > Sent: Thursday, March 5, 2015 1:43:33 PM > Subject: [ceph-users] rgw admin api - users > > According to the docs at > http://docs.ceph.com/docs/master/r

Re: [ceph-users] S3 RadosGW - Create bucket OP

2015-03-09 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Steffen Winther" > To: ceph-users@lists.ceph.com > Sent: Monday, March 9, 2015 12:43:58 AM > Subject: Re: [ceph-users] S3 RadosGW - Create bucket OP > > Steffen W Sørensen writes: > > > Response: > > HTTP/1.1 200 OK > > Date: Fri, 06 Mar 2015 10:41:14 GMT

Re: [ceph-users] S3 RadosGW - Create bucket OP

2015-03-09 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Steffen Winther" > To: ceph-users@lists.ceph.com > Sent: Monday, March 9, 2015 1:25:43 PM > Subject: Re: [ceph-users] S3 RadosGW - Create bucket OP > > Yehuda Sadeh-Weinraub writes: > > > > If you're using ap

Re: [ceph-users] S3 RadosGW - Create bucket OP

2015-03-10 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Steffen Winther" > To: ceph-users@lists.ceph.com > Sent: Tuesday, March 10, 2015 12:06:38 AM > Subject: Re: [ceph-users] S3 RadosGW - Create bucket OP > > Yehuda Sadeh-Weinraub writes: > > > Accordi

Re: [ceph-users] Shadow files

2015-03-12 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Ben" > To: ceph-us...@ceph.com > Sent: Wednesday, March 11, 2015 8:46:25 PM > Subject: Re: [ceph-users] Shadow files > > Anyone got any info on this? > > Is it safe to delete shadow files? It depends. Shadow files are badly named objects that represent pa

Re: [ceph-users] not existing key from s3 list

2015-03-13 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Dominik Mostowiec" > To: ceph-users@lists.ceph.com > Sent: Friday, March 13, 2015 4:50:18 PM > Subject: [ceph-users] not existing key from s3 list > > Hi, > I found a strange problem with not existing file in s3. > Object exists in list > # s3 -u list bucke

Re: [ceph-users] RadosGW Direct Upload Limitation

2015-03-16 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Craig Lewis" > To: "Gregory Farnum" > Cc: ceph-users@lists.ceph.com > Sent: Monday, March 16, 2015 11:48:15 AM > Subject: Re: [ceph-users] RadosGW Direct Upload Limitation > > > > > Maybe, but I'm not sure if Yehuda would want to take it upstream or > n

Re: [ceph-users] Shadow files

2015-03-17 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Ben" > To: "Craig Lewis" > Cc: "Yehuda Sadeh-Weinraub" , "ceph-users" > > Sent: Monday, March 16, 2015 3:38:42 PM > Subject: Re: [ceph-users] Shadow files > > Thats the thing. The peaks a

Re: [ceph-users] Shadow files

2015-03-18 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Ben" > To: "Yehuda Sadeh-Weinraub" > Cc: "Craig Lewis" , "ceph-users" > > Sent: Tuesday, March 17, 2015 7:28:28 PM > Subject: Re: [ceph-users] Shadow files > > None of this helps with tr

Re: [ceph-users] Shadow files

2015-03-18 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Abhishek L" > To: "Yehuda Sadeh-Weinraub" > Cc: "Ben" , "ceph-users" > Sent: Wednesday, March 18, 2015 10:54:37 AM > Subject: Re: [ceph-users] Shadow files > > > Yehuda Sadeh-Weinraub wr

Re: [ceph-users] FastCGI and RadosGW issue?

2015-03-19 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Potato Farmer" > To: ceph-users@lists.ceph.com > Sent: Thursday, March 19, 2015 12:26:41 PM > Subject: [ceph-users] FastCGI and RadosGW issue? > > > > Hi, > > > > I am running into an issue uploading to a bucket over an s3 connection to > ceph. I can c

Re: [ceph-users] Auth URL not found when using object gateway

2015-03-24 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Greg Meier" > To: ceph-users@lists.ceph.com > Sent: Tuesday, March 24, 2015 4:24:16 PM > Subject: [ceph-users] Auth URL not found when using object gateway > > Hi, > > I'm having trouble setting up an object gateway on an existing cluster. The > cluster I'

Re: [ceph-users] Radosgw authorization failed

2015-03-25 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Neville" > To: ceph-users@lists.ceph.com > Sent: Wednesday, March 25, 2015 8:16:39 AM > Subject: [ceph-users] Radosgw authorization failed > > Hi all, > > I'm testing backup product which supports Amazon S3 as target for Archive > storage and I'm trying to

Re: [ceph-users] Radosgw authorization failed

2015-03-30 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Neville" > To: "Yehuda Sadeh-Weinraub" > Cc: ceph-users@lists.ceph.com > Sent: Monday, March 30, 2015 6:49:29 AM > Subject: Re: [ceph-users] Radosgw authorization failed > > > > Date: Wed, 25 Mar 2015 11

Re: [ceph-users] Radosgw authorization failed

2015-04-01 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Neville" > To: "Yehuda Sadeh-Weinraub" > Cc: ceph-users@lists.ceph.com > Sent: Wednesday, April 1, 2015 11:45:09 AM > Subject: Re: [ceph-users] Radosgw authorization failed > > > > > On 31 Mar 2015, at

Re: [ceph-users] RADOS Gateway quota management

2015-04-02 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Sergey Arkhipov" > To: ceph-users@lists.ceph.com > Sent: Monday, March 30, 2015 2:55:33 AM > Subject: [ceph-users] RADOS Gateway quota management > Hi, > Currently I am trying to figure out how to work with RADOS Gateway (ceph > 0.87) limits and I've manage

Re: [ceph-users] RADOS Gateway quota management

2015-04-03 Thread Yehuda Sadeh-Weinraub
Great, I opened issue # 11323. Thanks, Yehuda - Original Message - > From: "Sergey Arkhipov" > To: "Yehuda Sadeh-Weinraub" > Cc: ceph-users@lists.ceph.com > Sent: Friday, April 3, 2015 1:00:02 AM > Subject: Re: [ceph-users] RADOS Gateway quota

Re: [ceph-users] Purpose of the s3gw.fcgi script?

2015-04-12 Thread Yehuda Sadeh-Weinraub
You're not missing anything. The script was only needed when we used the process manager of the fastcgi module, but it has been very long since we stopped using it. Yehuda - Original Message - > From: "Greg Meier" > To: ceph-users@lists.ceph.com > Sent: Saturday, April 11, 2015 10:54:2

Re: [ceph-users] Radosgw: upgrade Firefly to Hammer, impossible to create bucket

2015-04-13 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Francois Lafont" > To: ceph-users@lists.ceph.com > Sent: Sunday, April 12, 2015 8:47:40 PM > Subject: [ceph-users] Radosgw: upgrade Firefly to Hammer, impossible to > create bucket > > Hi, > > On a testing cluster, I have a radosgw on Firefly and the

Re: [ceph-users] Purpose of the s3gw.fcgi script?

2015-04-13 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Francois Lafont" > To: ceph-users@lists.ceph.com > Sent: Monday, April 13, 2015 5:17:47 PM > Subject: Re: [ceph-users] Purpose of the s3gw.fcgi script? > > Hi, > > Yehuda Sadeh-Weinraub wrote: > > > You're

Re: [ceph-users] Radosgw: upgrade Firefly to Hammer, impossible to create bucket

2015-04-14 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Francois Lafont" > To: ceph-users@lists.ceph.com > Sent: Monday, April 13, 2015 7:11:49 PM > Subject: Re: [ceph-users] Radosgw: upgrade Firefly to Hammer, impossible to > create bucket > > Hi, > > Yehuda Sadeh-Weinra

Re: [ceph-users] Swift and Ceph

2015-04-23 Thread Yehuda Sadeh-Weinraub
Sounds like you're hitting a known issue that was fixed a while back (although might not be fixed on the specific version you're running). Can you try creating a second subuser for the same user, see if that one works? Yehuda - Original Message - > From: "alistair whittle" > To: ceph-u

Re: [ceph-users] Swift and Ceph

2015-04-23 Thread Yehuda Sadeh-Weinraub
is packaged with ICE 1.2.2. I > believe that is the Firefly release. > > > -Original Message- > From: Yehuda Sadeh-Weinraub [mailto:yeh...@redhat.com] > Sent: Thursday, April 23, 2015 6:18 PM > To: Whittle, Alistair: Investment Bank (LDN) > Cc: ceph-users@lists

Re: [ceph-users] Shadow Files

2015-04-24 Thread Yehuda Sadeh-Weinraub
What version are you running? There are two different issues that we were fixing this week, and we should have that upstream pretty soon. Yehuda - Original Message - > From: "Ben" > To: "ceph-users" > Cc: "Yehuda Sadeh-Weinraub" > Sent: Thu

Re: [ceph-users] Shadow Files

2015-04-24 Thread Yehuda Sadeh-Weinraub
These ones: http://tracker.ceph.com/issues/10295 http://tracker.ceph.com/issues/11447 - Original Message - > From: "Ben Jackson" > To: "Yehuda Sadeh-Weinraub" > Cc: "ceph-users" > Sent: Friday, April 24, 2015 3:06:02 PM > Subject: Re: [

Re: [ceph-users] Shadow Files

2015-04-25 Thread Yehuda Sadeh-Weinraub
Yeah, that's definitely something that we'd address soon. Yehuda - Original Message - > From: "Ben" > To: "Ben Hines" , "Yehuda Sadeh-Weinraub" > > Cc: "ceph-users" > Sent: Friday, April 24, 2015 5:14:11 PM > Subj

Re: [ceph-users] Shadow Files

2015-04-27 Thread Yehuda Sadeh-Weinraub
It will get to the ceph mainline eventually. We're still reviewing and testing the fix, and there's more work to be done on the cleanup tool. Yehuda - Original Message - > From: "Ben" > To: "Yehuda Sadeh-Weinraub" > Cc: "ceph-users&

Re: [ceph-users] Civet RadosGW S3 not storing complete obects; civetweb logs stop after rotation

2015-04-28 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Sean" > To: ceph-users@lists.ceph.com > Sent: Tuesday, April 28, 2015 2:52:35 PM > Subject: [ceph-users] Civet RadosGW S3 not storing complete obects; civetweb > logs stop after rotation > > Hey yall! > > I have a weird issue and I am not sure where to lo

Re: [ceph-users] Civet RadosGW S3 not storing complete obects; civetweb logs stop after rotation

2015-05-02 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Sean" > To: "Yehuda Sadeh-Weinraub" > Cc: ceph-users@lists.ceph.com > Sent: Friday, May 1, 2015 6:47:09 PM > Subject: Re: [ceph-users] Civet RadosGW S3 not storing complete obects; > civetweb logs stop after rotat

Re: [ceph-users] Shadow Files

2015-05-04 Thread Yehuda Sadeh-Weinraub
le a job on the radosgw process. Please let me know of any issue you find. Thanks, Yehuda - Original Message - > From: "Ben Hines" > To: "Ben" > Cc: "Yehuda Sadeh-Weinraub" , "ceph-users" > > Sent: Thursday, April 30, 2015 3:00:16 PM

Re: [ceph-users] Shadow Files

2015-05-05 Thread Yehuda Sadeh-Weinraub
Can you try creating the .log pool? Yehda - Original Message - > From: "Anthony Alba" > To: "Yehuda Sadeh-Weinraub" > Cc: "Ben" , "ceph-users" > Sent: Tuesday, May 5, 2015 3:37:15 AM > Subject: Re: [ceph-users] Shadow Files &

Re: [ceph-users] Shadow Files

2015-05-05 Thread Yehuda Sadeh-Weinraub
rom: "Anthony Alba" > To: "Yehuda Sadeh-Weinraub" > Cc: "Ben" , "ceph-users" > Sent: Tuesday, May 5, 2015 10:14:38 AM > Subject: Re: [ceph-users] Shadow Files > > Unfortunately it immediately aborted (running against a 0.80.9 Ceph). > Doe

Re: [ceph-users] Civet RadosGW S3 not storing complete obects; civetweb logs stop after rotation

2015-05-06 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Sean" > To: "Yehuda Sadeh-Weinraub" > Cc: ceph-users@lists.ceph.com > Sent: Tuesday, May 5, 2015 12:14:19 PM > Subject: Re: [ceph-users] Civet RadosGW S3 not storing complete obects; > civetweb logs stop after rotatio

Re: [ceph-users] RGW - Can't download complete object

2015-05-07 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Sean" > To: ceph-users@lists.ceph.com > Sent: Thursday, May 7, 2015 3:35:14 PM > Subject: [ceph-users] RGW - Can't download complete object > > I have another thread goign on about truncation of objects and I believe > this is a separate but equally bad iss

Re: [ceph-users] civetweb lockups

2015-05-11 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Daniel Hoffman" > To: "ceph-users" > Sent: Sunday, May 10, 2015 10:54:21 PM > Subject: [ceph-users] civetweb lockups > Hi All. > We have a wierd issue where civetweb just locks up, it just fails to respond > to HTTP and a restart resolves the problem. This

Re: [ceph-users] Shadow Files

2015-05-11 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "Daniel Hoffman" > To: "Yehuda Sadeh-Weinraub" > Cc: "Ben" , "ceph-users" > Sent: Sunday, May 10, 2015 5:03:22 PM > Subject: Re: [ceph-users] Shadow Files > Any updates on when this is going t

Re: [ceph-users] Shadow Files

2015-05-11 Thread Yehuda Sadeh-Weinraub
It's the wip-rgw-orphans branch. - Original Message - > From: "Daniel Hoffman" > To: "Yehuda Sadeh-Weinraub" > Cc: "Ben" , "David Zafman" , > "ceph-users" > Sent: Monday, May 11, 2015 4:30:11 PM > Subject: Re: [

Re: [ceph-users] Civet RadosGW S3 not storing complete obects; civetweb logs stop after rotation

2015-05-12 Thread Yehuda Sadeh-Weinraub
Hi, Thank you for a very thorough investigation. See my comments below: - Original Message - > From: "Mark Murphy" > To: "Yehuda Sadeh-Weinraub" > Cc: "Sean Sullivan" , ceph-users@lists.ceph.com > Sent: Tuesday, May 12, 2015 10:50:49 AM > S

Re: [ceph-users] Civet RadosGW S3 not storing complete obects; civetweb logs stop after rotation

2015-05-12 Thread Yehuda Sadeh-Weinraub
I opened issue #11604, and have a fix for the issue. I updated our test suite to cover the specific issue that you were hitting. We'll backport the fix to both hammer and firefly soon. Thanks! Yehuda - Original Message - > From: "Yehuda Sadeh-Weinraub" > To: &quo

Re: [ceph-users] RGW - Can't download complete object

2015-05-13 Thread Yehuda Sadeh-Weinraub
xplain the manifest, I'll need to take a look at the code. Could such a sequence happen with the client that you're using to upload? Yehuda - Original Message - > From: "Sean Sullivan" > To: "Yehuda Sadeh-Weinraub" > Cc: ceph-users@lists.ceph.com

Re: [ceph-users] RGW - Can't download complete object

2015-05-13 Thread Yehuda Sadeh-Weinraub
er we test for any regressions. Thanks, Yehuda - Original Message - > From: "Yehuda Sadeh-Weinraub" > To: "Sean Sullivan" > Cc: ceph-users@lists.ceph.com > Sent: Wednesday, May 13, 2015 2:33:07 PM > Subject: Re: [ceph-users] RGW - Can't download co

Re: [ceph-users] RGW - Can't download complete object

2015-05-13 Thread Yehuda Sadeh-Weinraub
gt; for me to pull this code in? Is it in master? > > > On May 13, 2015 7:08:44 PM Yehuda Sadeh-Weinraub wrote: > > > Ok, I dug a bit more, and it seems to me that the problem is with the > > manifest that was created. I was able to reproduce a similar issue (opened >

Re: [ceph-users] radosgw crash within libfcgi

2015-06-24 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "GuangYang" > To: ceph-de...@vger.kernel.org, ceph-users@lists.ceph.com, yeh...@redhat.com > Sent: Wednesday, June 24, 2015 10:09:58 AM > Subject: radosgw crash within libfcgi > > Hello Cephers, > Recently we have several radosgw daemon crashes with the same

Re: [ceph-users] radosgw crash within libfcgi

2015-06-24 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "GuangYang" > To: "Yehuda Sadeh-Weinraub" > Cc: ceph-de...@vger.kernel.org, ceph-users@lists.ceph.com > Sent: Wednesday, June 24, 2015 1:53:20 PM > Subject: RE: radosgw crash within libfcgi > > Thanks Yehuda

Re: [ceph-users] radosgw crash within libfcgi

2015-06-24 Thread Yehuda Sadeh-Weinraub
- Original Message - > From: "GuangYang" > To: "Yehuda Sadeh-Weinraub" > Cc: ceph-de...@vger.kernel.org, ceph-users@lists.ceph.com > Sent: Wednesday, June 24, 2015 2:12:23 PM > Subject: RE: radosgw crash within libfcgi > > -

Re: [ceph-users] radosgw crash within libfcgi

2015-06-24 Thread Yehuda Sadeh-Weinraub
) << "process_request() returned " << ret << dendl; } - FCGX_Finish_r(fcgx); - delete req; } Maybe this is a problem on the specific libfcgi version that you're using? - Original Message - > From: "Yehuda Sadeh-Weinraub" > To: "Gu

Re: [ceph-users] S3:Permissions of access-key

2015-08-28 Thread Yehuda Sadeh-Weinraub
On Fri, Aug 28, 2015 at 2:17 AM, Zhengqiankun wrote: > hi,Yehuda: > > I have a question and hope that you can help me answer it. Different > subuser of swift > > can set specific permissions, but why not set specific permission for > access-key of s3? > Probably because no one ever asked

Re: [ceph-users] Still have orphaned rgw shadow files, ceph 0.94.3

2015-08-31 Thread Yehuda Sadeh-Weinraub
As long as you're 100% sure that the prefix is only being used for the specific bucket that was previously removed, then it is safe to remove these objects. But please do double check and make sure that there's no other bucket that matches this prefix somehow. Yehuda On Mon, Aug 31, 2015 at 2:42

Re: [ceph-users] Still have orphaned rgw shadow files, ceph 0.94.3

2015-08-31 Thread Yehuda Sadeh-Weinraub
h > "default.8873277.32" > > default.8873277.32__shadow_.OkYjjANx6-qJOrjvdqdaHev-LHSvPhZ_15 > default.8873277.32__shadow_.a2qU3qodRf_E5b9pFTsKHHuX2RUC12g_2 > > > > On Mon, Aug 31, 2015 at 2:51 PM, Yehuda Sadeh-Weinraub > wrote: >> As long as you're 100%

<    1   2   3   4   5   6   >