Re: [ceph-users] OSD and Journal Files

2013-09-18 Thread Warren Wang
FWIW, we run into this same issue, and cannot get a good enough SSD: spinning ratio, and decided on simply running the journals on each (spinning) drive, for hosts that have 24 slots. The problem gets even worse when we're talking about some of the newer boxes. Warren Warren On Wed, Sep 18, 20

Re: [ceph-users] OSD and Journal Files

2013-09-18 Thread Mike Dawson
Joseph, With properly architected failure domains and replication in a Ceph cluster, RAID1 has diminishing returns. A well-designed CRUSH map should allow for failures at any level of your hierarchy (OSDs, hosts, racks, rows, etc) while protecting the data with a configurable number of copie

Re: [ceph-users] OSD and Journal Files

2013-09-18 Thread Gruher, Joseph R
>-Original Message- >From: ceph-users-boun...@lists.ceph.com [mailto:ceph-users- >boun...@lists.ceph.com] On Behalf Of Mike Dawson > > you need to understand losing an SSD will cause >the loss of ALL of the OSDs which had their journal on the failed SSD. > >First, you probably don't want

Re: [ceph-users] OSD and Journal Files

2013-09-18 Thread Corin Langosch
Am 18.09.2013 17:03, schrieb Mike Dawson: I think you'll be OK on CPU and RAM. I'm running latest dumpling here and with default settings each osd consumes more than 3 GB RAM peak. So with 48 GB RAM it would not be possible to run the desired 18 osds. I filed a bug report for this here htt

Re: [ceph-users] OSD and Journal Files

2013-09-18 Thread Ian_M_Porter
Dell - Internal Use - Confidential Thanks Mike, great info! -Original Message- From: Mike Dawson [mailto:mike.daw...@cloudapt.com] Sent: 18 September 2013 16:04 To: Porter, Ian M; ceph-users@lists.ceph.com Subject: Re: [ceph-users] OSD and Journal Files Ian, There are two schools of

Re: [ceph-users] OSD and Journal Files

2013-09-18 Thread Mark Nelson
Excellent overview Mike! Mark On 09/18/2013 10:03 AM, Mike Dawson wrote: Ian, There are two schools of thought here. Some people say, run the journal on a separate partition on the spinner alongside the OSD partition, and don't mess with SSDs for journals. This may be the best practice for an

Re: [ceph-users] OSD and Journal Files

2013-09-18 Thread Mike Dawson
Ian, There are two schools of thought here. Some people say, run the journal on a separate partition on the spinner alongside the OSD partition, and don't mess with SSDs for journals. This may be the best practice for an architecture of high-density chassis. The other design is to use SSDs f

[ceph-users] OSD and Journal Files

2013-09-18 Thread Ian_M_Porter
Dell - Internal Use - Confidential Hi, I read in the ceph documentation that one of the main performance snags in ceph was running the OSDs and journal files on the same disks and you should consider at a minimum running the journals on SSDs. Given I am looking to design a 150 TB cluster, I'm c