Re: [ceph-users] NVRAM cards as OSD journals

2016-05-25 Thread Christian Balzer
arameters is an exercise in futility? ^_- Christian > Thanks & Regards > Somnath > > -Original Message- > From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of > Brian :: Sent: Tuesday, May 24, 2016 1:37 AM > To: ceph-users@lists.ceph.com > Subje

Re: [ceph-users] NVRAM cards as OSD journals

2016-05-24 Thread Somnath Roy
From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Brian :: Sent: Tuesday, May 24, 2016 1:37 AM To: ceph-users@lists.ceph.com Subject: Re: [ceph-users] NVRAM cards as OSD journals Hello List To confirm what Christian has said. We have been playing with a 3 node 4 SSD (3610)

Re: [ceph-users] NVRAM cards as OSD journals

2016-05-24 Thread Brian ::
Hello List To confirm what Christian has said. We have been playing with a 3 node 4 SSD (3610) per node cluster. Putting the journals on the OSD SSDs we were getting 770MB /s sustained with large sequential writes, and 35 MB/s and about 9200 IOPS with small random writes. Putting an NVME as journa

Re: [ceph-users] NVRAM cards as OSD journals

2016-05-23 Thread Christian Balzer
Hello, On Fri, 20 May 2016 15:52:45 + EP Komarla wrote: > Hi, > > I am contemplating using a NVRAM card for OSD journals in place of SSD > drives in our ceph cluster. > > Configuration: > > * 4 Ceph servers > > * Each server has 24 OSDs (each OSD is a 1TB SAS drive) > >

Re: [ceph-users] NVRAM cards as OSD journals

2016-05-23 Thread Nick Fisk
> -Original Message- > From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of > Heath Albritton > Sent: 23 May 2016 01:24 > To: ceph-users@lists.ceph.com > Subject: Re: [ceph-users] NVRAM cards as OSD journals > > I'm contemplating the s

Re: [ceph-users] NVRAM cards as OSD journals

2016-05-22 Thread Heath Albritton
I'm contemplating the same thing as well. Or rather, I'm actually doing some testing. I have a Netlist EV3 and have seen ~6GB/s read and write for any block size larger than 16k or so, IIRC. Sebastien Han has a blog page with journal benchmarks, I've added the specifics there. This week, I e

Re: [ceph-users] NVRAM cards as OSD journals

2016-05-22 Thread Heath Albritton
I'm contemplating the same thing as well. Or rather, I'm actually doing some testing. I have a Netlist EV3 and have seen ~6GB/s read and write for any block size larger than 16k or so, IIRC. Sebastien Han has a blog page with journal benchmarks, I've added the specifics there. This week, I e

Re: [ceph-users] NVRAM cards as OSD journals

2016-05-22 Thread Adrian Saul
I am using Intel P3700DC 400G cards in a similar configuration (two per host) - perhaps you could look at cards of that capacity to meet your needs. I would suggest having such small journals would mean you will be constantly blocking on journal flushes which will impact write performance and l