[ceph-users] v0.61.2 'ceph df' can't use

2013-05-20 Thread Kelvin_Huang
Hi all, I upgrade Ceph to the v0.62, but I find the 'ceph df' command can't use... that show 'unrecognized command' , why ? that need other options ? ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-cep

[ceph-users] Hardware Sizing

2013-05-20 Thread Bjorn Mork
Hi Team, This is my first post to this community. I have some basic queries to start with CEPH software...I found that http://www.supermicro.com.tw/products/system/2U/6027/SSG-6027R-E1R12T.cfmis being recommend as a start of storage server. As my target is to start with 12 TB solution (productio

Re: [ceph-users] Hardware Sizing

2013-05-20 Thread Jens Kristian Søgaard
Hi, http://www.supermicro.com.tw/products/system/2U/6027/SSG-6027R-E1R12T.cfm is being recommend as a start of storage server. From my experience, don't start with their storage server. Instead look at "ordinary" models. Instead of having 1 server with 12 disk bays it is often better to hav

Re: [ceph-users] Kernel panic on rbd map when cluster is out of monitor quorum

2013-05-20 Thread Joe Ryner
Hi, My kernels are running: 3.8.11-200.fc18.x86_64 and 3.8.9-200.fc18.x86_64 My cephx settings are below auth cluster required = cephx auth service required = cephx auth client required = cephx I will be working on my test cluster later this week and will try to reproduc

[ceph-users] RGW

2013-05-20 Thread Gandalf Corvotempesta
Hi, i'm receiving an EntityTooLarge error when trying to upload an object of 100MB I've already set LimitRequestBody to 0 in apache. Anyting else to check ? ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-use

[ceph-users] planning ceph from admin perspective. Ceph calculator?

2013-05-20 Thread Ugis
Hi, Seems more and more that ceph is out in the wild - people are using it for production, development speeds up etc. Still how can one pick the configuration suiting his needs? For example, we wish to replace older SAN IBM/HP storages with ceph, we know iops, bandwidth capabilities of those, bu

Re: [ceph-users] scrub error: found clone without head

2013-05-20 Thread Dzianis Kahanovich
http://tracker.ceph.com/issues/4937 For me it progressed up to ceph reinstall with repair data from backup (I help ceph die, but it was IMHO self-provocation for force reinstall). Now (at least to my summer outdoors) I keep v0.62 (3 nodes) with every pool size=3 min_size=2 (was - size=2 min_size=1

Re: [ceph-users] Hardware Sizing

2013-05-20 Thread Mark Nelson
On 05/20/2013 08:01 AM, Bjorn Mork wrote: Hi Team, This is my first post to this community. I have some basic queries to start with CEPH software...I found that http://www.supermicro.com.tw/products/system/2U/6027/SSG-6027R-E1R12T.cfm is being recommend as a start of storage server. This is a

Re: [ceph-users] scrub error: found clone without head

2013-05-20 Thread Olivier Bonvalet
Great, thanks. I will follow this issue, and add informations if needed. Le lundi 20 mai 2013 à 17:22 +0300, Dzianis Kahanovich a écrit : > http://tracker.ceph.com/issues/4937 > > For me it progressed up to ceph reinstall with repair data from backup (I help > ceph die, but it was IMHO self-provo

[ceph-users] Setting OSD weight

2013-05-20 Thread Alex Bligh
How do I set the weight for OSDs? I have 4 OSDs I want to create with very low weight (<1) so they are never used if any other OSDs are added subsequently (and would like to avoid placement groups). These OSDs have been created with default settings using the manual OSD add procedure as per ceph d

Re: [ceph-users] v0.61.2 'ceph df' can't use

2013-05-20 Thread Sage Weil
On Mon, 20 May 2013, kelvin_hu...@wiwynn.com wrote: > Hi all, > I upgrade Ceph to the v0.62, but I find the 'ceph df' command can't use... > that show 'unrecognized command' , why ? that need other options ? Make sure the ceph-mon daemons have been restarted so that they are running the new vers

[ceph-users] Inconsistent PG's, repair ineffective

2013-05-20 Thread John Nielsen
Some scrub errors showed up on our cluster last week. We had some issues with host stability a couple weeks ago; my guess is that errors were introduced at that point and a recent background scrub detected them. I was able to clear most of them via "ceph pg repair", but several remain. Based on

Re: [ceph-users] Setting OSD weight

2013-05-20 Thread Sage Weil
Look at 'ceph osd tree'. The weight value in 'ceph osd dump' output is the in/out correction, not the crush weight. s On Mon, 20 May 2013, Alex Bligh wrote: > How do I set the weight for OSDs? I have 4 OSDs I want to create > with very low weight (<1) so they are never used if any other OSDs >

Re: [ceph-users] Setting OSD weight

2013-05-20 Thread Alex Bligh
On 20 May 2013, at 17:19, Sage Weil wrote: > Look at 'ceph osd tree'. The weight value in 'ceph osd dump' output is > the in/out correction, not the crush weight. Doh. Thanks. Is there a difference between: ceph osd crush set 0 2 root=default and ceph osd crush reweight osd.0 2 ? -- Ale

[ceph-users] (no subject)

2013-05-20 Thread Nicolas Fernandez
___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] Growing the cluster.

2013-05-20 Thread Nicolas Fernandez
Hello, I'm deploying a test cluster on 0.61.2 version between two nodes (OSD/MDS), and another (MON). I have a problem making my cluster grow, today i've added an OSD into a node that was a osd exist. I've made a reweight and add a replica.The crushmap is up to date but now i'm getting some pgs in

Re: [ceph-users] v0.61.2 'ceph df' can't use

2013-05-20 Thread Joao Eduardo Luis
On 05/20/2013 10:28 AM, kelvin_hu...@wiwynn.com wrote: Hi all, I upgrade Ceph to the v0.62, but I find the 'ceph df' command can't use... that show 'unrecognized command' , why ? that need other options ? Have you made sure both the client and the monitors have been upgraded accordingly? Hav

Re: [ceph-users] RadosGW High Availability

2013-05-20 Thread Igor Laskovy
Hi all, Well, looks like DragonDisk (http://www.dragondisk.com/) deal with RRDNS well, it just run with both RGWs ;) But what actually I need to know now is why RGW not start at boot time with "Initialization timeout, failed to initialize" error in logs. It run successful by hands after that. O

[ceph-users] Determining when an 'out' OSD is actually unused

2013-05-20 Thread Alex Bligh
If I want to remove an osd, I use 'ceph out' before taking it down, i.e. stopping the OSD process, and removing the disk. How do I (preferably programatically) tell when it is safe to stop the OSD process? The documentation says 'ceph -w', which is not especially helpful, (a) if I want to do it

Re: [ceph-users] Determining when an 'out' OSD is actually unused

2013-05-20 Thread Dan Mick
On 05/20/2013 01:33 PM, Alex Bligh wrote: If I want to remove an osd, I use 'ceph out' before taking it down, i.e. stopping the OSD process, and removing the disk. How do I (preferably programatically) tell when it is safe to stop the OSD process? The documentation says 'ceph -w', which is n

Re: [ceph-users] Growing the cluster.

2013-05-20 Thread Dan Mick
What does your crushmap look like? There's a good chance you're choosing first hosts, and then OSDs, which means you can't come up with 3 replicas (because there are only two hosts). Try: ceph -o my.crush.map osd getcrushmap crushtool -i my.crush.map --test --output-csv and then look at the .

Re: [ceph-users] ceph v6.1, rbd-fuse issue, rbd_list: error %d Numerical result out of range

2013-05-20 Thread Dan Mick
Hi Sean: It looks to me like this is the result of the simple-minded[1] strategy for allocating a return buffer for rbd_list(): ibuf_len = 1024; ibuf = malloc(ibuf_len); actual_len = rbd_list(ioctx, ibuf, &ibuf_len); if (actual_len < 0) { simple_

Re: [ceph-users] Determining when an 'out' OSD is actually unused

2013-05-20 Thread Alex Bligh
Dan, On 21 May 2013, at 00:52, Dan Mick wrote: > On 05/20/2013 01:33 PM, Alex Bligh wrote: >> If I want to remove an osd, I use 'ceph out' before taking it down, i.e. >> stopping the OSD process, and removing the disk. >> >> How do I (preferably programatically) tell when it is safe to stop the

Re: [ceph-users] Inconsistent PG's, repair ineffective

2013-05-20 Thread David Zafman
What version of ceph are you running? David Zafman Senior Developer http://www.inktank.com On May 20, 2013, at 9:14 AM, John Nielsen wrote: > Some scrub errors showed up on our cluster last week. We had some issues with > host stability a couple weeks ago; my guess is that errors were introdu

Re: [ceph-users] Determining when an 'out' OSD is actually unused

2013-05-20 Thread Dan Mick
Yes, with the proviso that you really mean "kill the osd" when clean. Marking out is step 1. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com