Re: [ceph-users] SSDs: cache pool/tier versus node-local block cache

2014-04-20 Thread Blair Bethwaite
Hi Christian, On 18 April 2014 12:28, Christian Balzer wrote: > > On Fri, 18 Apr 2014 11:34:15 +1000 Blair Bethwaite wrote: > > So the PERC 710p, whilst not having the native JBOD mode of the > > underlying LSI 2208 chipset, does allow per- virtual-disk cache and > > read-ahead mode settings. It

Re: [ceph-users] SSDs: cache pool/tier versus node-local block cache

2014-04-17 Thread Christian Balzer
On Fri, 18 Apr 2014 11:34:15 +1000 Blair Bethwaite wrote: > > Message: 20 > > Date: Thu, 17 Apr 2014 17:45:39 +0900 > > From: Christian Balzer > > To: "ceph-users@lists.ceph.com" > > Subject: Re: [ceph-users] SSDs: cache pool/tier versus node-loca

Re: [ceph-users] SSDs: cache pool/tier versus node-local block cache

2014-04-17 Thread Blair Bethwaite
> Message: 20 > Date: Thu, 17 Apr 2014 17:45:39 +0900 > From: Christian Balzer > To: "ceph-users@lists.ceph.com" > Subject: Re: [ceph-users] SSDs: cache pool/tier versus node-local > block cache > Message-ID: <20140417174539.6c713...@batzmaru.gol

Re: [ceph-users] SSDs: cache pool/tier versus node-local block cache

2014-04-17 Thread Kyle Bader
>> >> I think the timing should work that we'll be deploying with Firefly and >> >> so >> >> have Ceph cache pool tiering as an option, but I'm also evaluating >> >> Bcache >> >> versus Tier to act as node-local block cache device. Does anybody have >> >> real >> >> or anecdotal evidence about whic

Re: [ceph-users] SSDs: cache pool/tier versus node-local block cache

2014-04-17 Thread Christian Balzer
On Thu, 17 Apr 2014 12:58:55 +1000 Blair Bethwaite wrote: > Hi Kyle, > > Thanks for the response. Further comments/queries... > > > Message: 42 > > Date: Wed, 16 Apr 2014 06:53:41 -0700 > > From: Kyle Bader > > Cc: ceph-users > > Subject: Re: [cep

Re: [ceph-users] SSDs: cache pool/tier versus node-local block cache

2014-04-16 Thread Blair Bethwaite
Hi Kyle, Thanks for the response. Further comments/queries... > Message: 42 > Date: Wed, 16 Apr 2014 06:53:41 -0700 > From: Kyle Bader > Cc: ceph-users > Subject: Re: [ceph-users] SSDs: cache pool/tier versus node-local > block cache > Message-ID: > &g

Re: [ceph-users] SSDs: cache pool/tier versus node-local block cache

2014-04-16 Thread Kyle Bader
>> Obviously the ssds could be used as journal devices, but I'm not really >> convinced whether this is worthwhile when all nodes have 1GB of hardware >> writeback cache (writes to journal and data areas on the same spindle have >> time to coalesce in the cache and minimise seek time hurt). Any adv

Re: [ceph-users] SSDs: cache pool/tier versus node-local block cache

2014-04-16 Thread Blair Bethwaite
New idea that is dependent on failure behaviour of the cache tier... Carve the ssds 4-ways: each with 3 partitions for journals servicing the backing data pool and a fourth larger partition serving a write-around cache tier with only 1 object copy. Thus both reads and writes hit ssd but the ssd ca

[ceph-users] SSDs: cache pool/tier versus node-local block cache

2014-04-15 Thread Blair Bethwaite
Hi all, We'll soon be configuring a new cluster, hardware is already purchased - OSD nodes are Dell R720XDs (E5-2630v2, 32GB RAM, PERC 710p, 9x 4TB NL-SAS, 3x 200GB Intel DC S3700, Mellanox CX3 10GE DP). 12 of these to start with. So we have a 3:1 spindle:ssd ratio, but as yet I'm not sure how we