Re: [ceph-users] Can't start radosgw

2013-03-27 Thread Andreas Kurz
On 2013-03-26 17:07, Romeo M wrote: > Hi all, > > Anyone have any ideas on this? It's driving us nuts! Sharing your current configuration might help. Is the radosgw on an extra host or together with some other Ceph daemon? Regards, Andreas > > Thanks! > > Rom > > >

Re: [ceph-users] Journal size

2013-03-27 Thread Aleksey Samarin
Well, after few tests, i can't increase size of journal. I think size of journal set only when osd create. So for change journal size u need to delete osd and create with new journal. 2013/3/26 Chen, Xiaoxi > Are you using a partition as journal? > > ** ** > > *From:* ceph-users-boun...@l

Re: [ceph-users] kernel BUG when mapping unexisting rbd device

2013-03-27 Thread Alex Elder
On 03/25/2013 06:03 AM, Dan van der Ster wrote: > Hi, > Apologies if this is already a known bug (though I didn't find it). > > If we try to map a device that doesn't exist, we get an immediate and > reproduceable kernel BUG (see the P.S.). We hit this by accident > because we forgot to add the --

Re: [ceph-users] Journal size

2013-03-27 Thread John Nielsen
Sébastien Han actually covers this on his blog: http://www.sebastien-han.fr/blog/2012/08/17/ceph-storage-node-maintenance/ His use case is moving from an embedded journal to one on an SSD but the steps can be used to move/recreate the journal for any reason: Mark the OSD "out" Stop the OSD daemo

Re: [ceph-users] Journal size

2013-03-27 Thread Sage Weil
On Wed, 27 Mar 2013, Aleksey Samarin wrote: > Well, after few tests, i can't increase size of journal. I think size of > journal set only when osd create. So for change journal size u need to > delete osd and create with new journal. ceph-osd --flush-journal (delete journal file) ceph-osd --mkjour

Re: [ceph-users] Journal size

2013-03-27 Thread Aleksey Samarin
Yeah! Thanks all for your replies! 2013/3/27 Sage Weil > On Wed, 27 Mar 2013, Aleksey Samarin wrote: > > Well, after few tests, i can't increase size of journal. I think size of > > journal set only when osd create. So for change journal size u need to > > delete osd and create with new journal.

Re: [ceph-users] Journal size

2013-03-27 Thread Gregory Farnum
This should actually be "down", not "out". Out will trigger a data migration. :) -Greg Software Engineer #42 @ http://inktank.com | http://ceph.com On Wed, Mar 27, 2013 at 8:36 AM, John Nielsen wrote: > Sébastien Han actually covers this on his blog: > > http://www.sebastien-han.fr/blog/2012/08

Re: [ceph-users] Journal size

2013-03-27 Thread John Nielsen
Indeed, thanks! Sébastien, care to update your helpful blog post? On Mar 27, 2013, at 10:04 AM, Gregory Farnum wrote: > This should actually be "down", not "out". Out will trigger a data migration. > :) > -Greg > > Software Engineer #42 @ http://inktank.com | http://ceph.com > > > On Wed, Ma

Re: [ceph-users] Journal size

2013-03-27 Thread Sebastien Han
Yes I will :-), thank you for pointing out this to me.Sébastien HanCloud Engineer"Always give 100%. Unless you're giving blood."PHONE : +33 (0)1 49 70 99 72 – MOBILE : +33 (0)6 52 84 44 70EMAIL : sebastien@enovance.com – SKYPE : han.sbastienADDRESS : 10, rue de la Victoire – 75009 ParisWEB

Re: [ceph-users] Journal size

2013-03-27 Thread Sebastien Han
I just edited the post, I opted for the 'noout' option at the end. It's the one that makes the most sense to me.Sébastien HanCloud Engineer"Always give 100%. Unless you're giving blood."PHONE : +33 (0)1 49 70 99 72 – MOBILE : +33 (0)6 52 84 44 70EMAIL : sebastien@enovance.com – SKYPE : han.

[ceph-users] CTDB Cluster Samba on Cephfs

2013-03-27 Thread Marco Aroldi
Hi list, I'm trying to create a active/active Samba cluster on top of Cephfs I would ask if Ceph fully supports CTDB at this time. I've found some (maybe outdated) documentation on the net in witch the Ceph support is still marked with a question mark or with a "soon..." note Thank you -- Marco

Re: [ceph-users] Object location

2013-03-27 Thread Sebastien Han
Ok,I just noticed that the documentation seems to be wrong, the correct command to find the location of an object is:$ ceph odd map Then, the error that you raised is pretty strange because even the object doesn't exist, the command will calculate the eventual location.Could you please paste _all_

Re: [ceph-users] Object location

2013-03-27 Thread Sebastien Han
Arf sorry, not 'odd' but 'osd' of course. (thanks autocompletion…)Sébastien HanCloud Engineer"Always give 100%. Unless you're giving blood."PHONE : +33 (0)1 49 70 99 72 – MOBILE : +33 (0)6 52 84 44 70EMAIL : sebastien@enovance.com – SKYPE : han.sbastienADDRESS : 10, rue de la Victoire – 750

Re: [ceph-users] Object location

2013-03-27 Thread John Wilkins
Sebastian, You're correct. The usage has changed, so I've updated the doc to reflect it. I ran through the procedure and it worked fine for me. Sorry Waed. I hope that's all that was wrong. On Wed, Mar 27, 2013 at 3:48 PM, Sebastien Han wrote: > Arf sorry, not 'odd' but 'osd' of course. (thanks

Re: [ceph-users] Cluster Map Problems

2013-03-27 Thread John Wilkins
We need a bit more information. If you can do: "ceph osd dump", "ceph osd tree", and paste your ceph conf, we might get a bit further. The CRUSH hierarchy looks okay. I can't see the replica size from this though. Have you followed this procedure to see if your object is getting remapped? http://

Re: [ceph-users] Object location

2013-03-27 Thread Sebastien Han
Hi John,Could you also please update the generic usage at the beginning of the section?Thanks!ps: I tried to push a change, but something went wrong with Github...Sébastien HanCloud Engineer"Always give 100%. Unless you're giving blood."PHONE : +33 (0)1 49 70 99 72 – MOBILE : +33 (0)6 52 84 44

Re: [ceph-users] Object location

2013-03-27 Thread John Wilkins
Already done. Missed it at first. Thanks! :) On Wed, Mar 27, 2013 at 5:17 PM, Sebastien Han wrote: > Hi John, > > Could you also please update the generic usage at the beginning of the > section? > > Thanks! > > ps: I tried to push a change, but something went wrong with Github... > > > Séba

Re: [ceph-users] Cluster Map Problems

2013-03-27 Thread Martin Mailand
Hi, that's the config http://pastebin.com/2JzABSYt ceph osd dump http://pastebin.com/GSCGKL1k ceph osd tree http://pastebin.com/VSgPFRYv As far as I can tell they are not mapped right. sdmap e133 pool 'rbd' (2) object '2.31a' -> pg 2.f3caaf00 (2.300) -> up [13,23] acting [13,23] -martin On 28.

[ceph-users] Mon crash

2013-03-27 Thread Martin Mailand
Hi, today one of my mons crashed, the log is here. http://pastebin.com/ugr1fMJR I think the most important part is: 2013-03-28 01:57:48.564647 7fac6c0ea700 -1 auth/none/AuthNoneServiceHandler.h: In function 'virtual int AuthNoneServiceHandler::handle_request(ceph::buffer::list::iterator&, ceph::b

Re: [ceph-users] Cluster Map Problems

2013-03-27 Thread John Wilkins
So the OSD you shutdown is down and in. How long does it stay in the degraded state? In the docs here, http://ceph.com/docs/master/rados/operations/monitoring-osd-pg/ , we discuss the notion that a down OSD is not technically out of the cluster for awhile. I believe the default value is 300 seconds

Re: [ceph-users] Mon crash

2013-03-27 Thread John Wilkins
Martin, A crash is usually a bug. You should report this to the ceph-devel list. On Wed, Mar 27, 2013 at 6:03 PM, Martin Mailand wrote: > Hi, > > today one of my mons crashed, the log is here. > http://pastebin.com/ugr1fMJR > > I think the most important part is: > 2013-03-28 01:57:48.564647 7fa

Re: [ceph-users] Cluster Map Problems

2013-03-27 Thread Martin Mailand
Hi John, if I shut down a osd, the cluster stays in degraded status for hours and there is no recovery traffic at all. -martin On 28.03.2013 02:25, John Wilkins wrote: > So the OSD you shutdown is down and in. How long does it stay in the > degraded state? In the docs here, > http://ceph.com/do

Re: [ceph-users] Cluster Map Problems

2013-03-27 Thread Martin Mailand
Hi John, I still think this part in the crushmap is wrong. step take default step choose firstn 0 type rack step chooseleaf firstn 0 type host step emit I first take from the defaut -> that's okay, Now I take two from the rack -> that's still ok But now, I will ta

Re: [ceph-users] Can't start radosgw

2013-03-27 Thread Romeo M
Hi Andreas, We're running it on a storage node (it's running 4 OSD processes, but no mon processes).  Here's the config: Thanks! Rom [global]     auth supported = cephx     auth cluster required = cephx     auth service required = cephx     auth client required = cephx [osd]

Re: [ceph-users] Can't start radosgw

2013-03-27 Thread Romeo M
Okay, John Wilkins suggested turning off authentication to see if that works...  and it seems to have! We commented our the three "required" auth lines in global, and radosgw started right up. However, we don't really want to run without auth, so anyone have any ideas what the issue could be w

Re: [ceph-users] CTDB Cluster Samba on Cephfs

2013-03-27 Thread Matthieu Patou
On 03/27/2013 10:41 AM, Marco Aroldi wrote: Hi list, I'm trying to create a active/active Samba cluster on top of Cephfs I would ask if Ceph fully supports CTDB at this time. If I'm not wrong Ceph (even CephFS) do not support exporting a block device or mounting the same FS more than once wherea