Re: [ceph-users] Hardware recommendation / calculation for large cluster

2013-05-13 Thread Leen Besselink
On Mon, May 13, 2013 at 09:30:38PM +0200, Tim Mohlmann wrote: > Hi, > > Ok, thanks for al the info. > > Just "fyi", I am a mechanical / electrical marine service engineer. So > basicly > I think in Pressure, Flow, Contents, Voltage, (mili)amps, power and torque. > So > I am just trying to rel

Re: [ceph-users] Hardware recommendation / calculation for large cluster

2013-05-13 Thread Tim Mohlmann
Hi, Ok, thanks for al the info. Just "fyi", I am a mechanical / electrical marine service engineer. So basicly I think in Pressure, Flow, Contents, Voltage, (mili)amps, power and torque. So I am just trying to relevate it to the same prinicple. Hence my questions. I am certainly not a noob in

Re: [ceph-users] Hardware recommendation / calculation for large cluster

2013-05-12 Thread Dmitri Maziuk
On 2013-05-12 08:34, Tim Mohlmann wrote: As for choking the backplane: That would just slow things down a bit, am I right? A bit, a lot, or not at all -- I think IRL you'll have to test it under your workload and see. [ WD performance ] Did not know that. Do you have any references. Does

Re: [ceph-users] Hardware recommendation / calculation for large cluster

2013-05-12 Thread Leen Besselink
On Sun, May 12, 2013 at 10:22:10PM +0200, Tim Mohlmann wrote: > Hi, > > On Sunday 12 May 2013 18:05:16 Leen Besselink wrote: > > > > > I did see you mentioned you wanted to have, many disks in the same machine. > > > > Not just machines with let's say 12 disks for example. > > > > Did you know

Re: [ceph-users] Hardware recommendation / calculation for large cluster

2013-05-12 Thread Tim Mohlmann
Hi, On Sunday 12 May 2013 18:05:16 Leen Besselink wrote: > > I did see you mentioned you wanted to have, many disks in the same machine. > > Not just machines with let's say 12 disks for example. > > Did you know you need the CPU-power of a 1Ghz Xeon core per OSD for the > times when recovery

Re: [ceph-users] Hardware recommendation / calculation for large cluster

2013-05-12 Thread Leen Besselink
On Sun, May 12, 2013 at 03:14:15PM +0200, Tim Mohlmann wrote: > Hi, > > On Saturday 11 May 2013 16:04:27 Leen Besselink wrote: > > > Someone is going to correct me if I'm wrong, but I think you misread > > something. > > > > > > The Mon-daemon doesn't need that much RAM: > > > > The 'RAM: 1 GB

Re: [ceph-users] Hardware recommendation / calculation for large cluster

2013-05-12 Thread Tim Mohlmann
Hi, On Saturday 11 May 2013 16:22:15 Dimitri Maziuk wrote: > SuperMicro has a new 4U chassis w/ 72x3.5" drives (2/canister). You can > double the number of drives. (With faster drives you may be getting > close to chocking the expander backplane, though.) Just checked their site and those are awes

Re: [ceph-users] Hardware recommendation / calculation for large cluster

2013-05-12 Thread Tim Mohlmann
Hi, On Saturday 11 May 2013 16:04:27 Leen Besselink wrote: > Someone is going to correct me if I'm wrong, but I think you misread > something. > > > The Mon-daemon doesn't need that much RAM: > > The 'RAM: 1 GB per daemon' is per Mon-daemon, not per OSD-daemon. > Gosh, I feel embarresed. This

Re: [ceph-users] Hardware recommendation / calculation for large cluster

2013-05-11 Thread Dimitri Maziuk
On 05/11/2013 08:42 AM, Tim Mohlmann wrote: > Each OSD server uses 4U and can take 36x3.5" drives. So in 36U I can put > 36/4=9 OSD servers, containing 9*36=324 HDDs. SuperMicro has a new 4U chassis w/ 72x3.5" drives (2/canister). You can double the number of drives. (With faster drives you may

Re: [ceph-users] Hardware recommendation / calculation for large cluster

2013-05-11 Thread Leen Besselink
Hi, Someone is going to correct me if I'm wrong, but I think you misread something. The Mon-daemon doesn't need that much RAM: The 'RAM: 1 GB per daemon' is per Mon-daemon, not per OSD-daemon. The same for disk-space. You should read this page again: http://ceph.com/docs/master/install/hardwa

[ceph-users] Hardware recommendation / calculation for large cluster

2013-05-11 Thread Tim Mohlmann
Hi, First of all I am new to ceph and this mailing list. At this moment I am looking into the possibilities to get involved in the storage business. I am trying to get an estimate about costs and after that I will start to determine how to get sufficient income. First I will describe my case,