Re: [zfs-discuss] High-Performance ZFS (2000MB/s+)

2010-06-16 Thread Christopher George
> I mean, could I stripe across multiple devices to be able to handle higher > throughput? Absolutely. Stripping four DDRdrive X1s (16GB dedicated log) is extremely simple. Each X1 has it's own dedicated IOPS controller, critical for approaching linear synchronous write scalability. The same

Re: [zfs-discuss] High-Performance ZFS (2000MB/s+)

2010-06-15 Thread Przemyslaw Ceglowski
On 15/06/2010 12:42, "Arve Paalsrud" wrote: > Hi, > > We are currently building a storage box based on OpenSolaris/Nexenta using > ZFS. > Our hardware specifications are as follows: > > Quad AMD G34 12-core 2.3 GHz (~110 GHz) > 10 Crucial RealSSD (6Gb/s) > 42 WD RAID Ed. 4 2TB disks + 6Gb/s SAS

Re: [zfs-discuss] High-Performance ZFS (2000MB/s+)

2010-06-15 Thread Garrett D'Amore
On Tue, 2010-06-15 at 18:33 +0200, Arve Paalsrud wrote: > > What about the ZIL bandwidth in this case? I mean, could I stripe across > multiple devices to be able to handle higher throughput? Otherwise I would > still be limited to the performance of the unit itself (155 MB/s). > I think so.

Re: [zfs-discuss] High-Performance ZFS (2000MB/s+)

2010-06-15 Thread Arve Paalsrud
> -Original Message- > From: Garrett D'Amore [mailto:garr...@nexenta.com] > Sent: 15. juni 2010 17:43 > To: Arve Paalsrud > Cc: zfs-discuss@opensolaris.org > Subject: Re: [zfs-discuss] High-Performance ZFS (2000MB/s+) > > On Tue, 2010-06-15 at 04:42 -0700

Re: [zfs-discuss] High-Performance ZFS (2000MB/s+)

2010-06-15 Thread Arve Paalsrud
On Tue, Jun 15, 2010 at 3:33 PM, Erik Trimble wrote: > On 6/15/2010 6:17 AM, Darren J Moffat wrote: > >> On 15/06/2010 14:09, Erik Trimble wrote: >> >>> I'm going to say something sacrilegious here: 128GB of RAM may be >>> overkill. You have the SSDs for L2ARC - much of which will be the DDT, >>>

Re: [zfs-discuss] High-Performance ZFS (2000MB/s+)

2010-06-15 Thread Arve Paalsrud
On Tue, Jun 15, 2010 at 4:20 PM, Erik Trimble wrote: > On 6/15/2010 6:57 AM, Arve Paalsrud wrote: > > On Tue, Jun 15, 2010 at 3:09 PM, Erik Trimble wrote: > > I'd go with 2 Intel X25-E 32GB models for ZIL. Mirror them - striping isn't >> really going to buy you much here (so far as I can tell).

Re: [zfs-discuss] High-Performance ZFS (2000MB/s+)

2010-06-15 Thread Arve Paalsrud
On Tue, Jun 15, 2010 at 3:09 PM, Erik Trimble wrote: > On 6/15/2010 4:42 AM, Arve Paalsrud wrote: > >> Hi, >> >> We are currently building a storage box based on OpenSolaris/Nexenta using >> ZFS. >> Our hardware specifications are as follows: >> >> Quad AMD G34 12-core 2.3 GHz (~110 GHz) >> 10 Cru

Re: [zfs-discuss] High-Performance ZFS (2000MB/s+)

2010-06-15 Thread Garrett D'Amore
On Tue, 2010-06-15 at 07:36 -0700, Richard Elling wrote: > > What I want to achieve is 2 GB/s+ NFS traffic against our ESX clusters > > (also InfiniBand-based), with both dedupe and compression enabled in ZFS. > > In general, both dedup and compression gain space by trading off performance. > You

Re: [zfs-discuss] High-Performance ZFS (2000MB/s+)

2010-06-15 Thread Garrett D'Amore
On Tue, 2010-06-15 at 04:42 -0700, Arve Paalsrud wrote: > Hi, > > We are currently building a storage box based on OpenSolaris/Nexenta using > ZFS. > Our hardware specifications are as follows: > > Quad AMD G34 12-core 2.3 GHz (~110 GHz) > 10 Crucial RealSSD (6Gb/s) > 42 WD RAID Ed. 4 2TB disks

Re: [zfs-discuss] High-Performance ZFS (2000MB/s+)

2010-06-15 Thread Richard Elling
On Jun 15, 2010, at 4:42 AM, Arve Paalsrud wrote: > Hi, > > We are currently building a storage box based on OpenSolaris/Nexenta using > ZFS. > Our hardware specifications are as follows: > > Quad AMD G34 12-core 2.3 GHz (~110 GHz) > 10 Crucial RealSSD (6Gb/s) > 42 WD RAID Ed. 4 2TB disks + 6Gb

Re: [zfs-discuss] High-Performance ZFS (2000MB/s+)

2010-06-15 Thread Richard Elling
On Jun 15, 2010, at 6:40 AM, Roy Sigurd Karlsbakk wrote: >> I'm going to say something sacrilegious here: 128GB of RAM may be >> overkill. You have the SSDs for L2ARC - much of which will be the DDT, >> but, if I'm reading this correctly, even if you switch to the 160GB >> Intel X25-M, that give y

Re: [zfs-discuss] High-Performance ZFS (2000MB/s+)

2010-06-15 Thread Erik Trimble
On 6/15/2010 6:40 AM, Roy Sigurd Karlsbakk wrote: I'm going to say something sacrilegious here: 128GB of RAM may be overkill. You have the SSDs for L2ARC - much of which will be the DDT, but, if I'm reading this correctly, even if you switch to the 160GB Intel X25-M, that give you 8 x 160GB = 128

Re: [zfs-discuss] High-Performance ZFS (2000MB/s+)

2010-06-15 Thread Roy Sigurd Karlsbakk
> I'm going to say something sacrilegious here: 128GB of RAM may be > overkill. You have the SSDs for L2ARC - much of which will be the DDT, > but, if I'm reading this correctly, even if you switch to the 160GB > Intel X25-M, that give you 8 x 160GB = 1280GB of L2ARC, of which only > half is in-use

Re: [zfs-discuss] High-Performance ZFS (2000MB/s+)

2010-06-15 Thread Erik Trimble
On 6/15/2010 6:17 AM, Darren J Moffat wrote: On 15/06/2010 14:09, Erik Trimble wrote: I'm going to say something sacrilegious here: 128GB of RAM may be overkill. You have the SSDs for L2ARC - much of which will be the DDT, The point of L2ARC is that you start adding L2ARC when you can no long

Re: [zfs-discuss] High-Performance ZFS (2000MB/s+)

2010-06-15 Thread Darren J Moffat
On 15/06/2010 14:09, Erik Trimble wrote: I'm going to say something sacrilegious here: 128GB of RAM may be overkill. You have the SSDs for L2ARC - much of which will be the DDT, The point of L2ARC is that you start adding L2ARC when you can no longer physically put in (or afford) to add any mo

Re: [zfs-discuss] High-Performance ZFS (2000MB/s+)

2010-06-15 Thread Erik Trimble
On 6/15/2010 4:42 AM, Arve Paalsrud wrote: Hi, We are currently building a storage box based on OpenSolaris/Nexenta using ZFS. Our hardware specifications are as follows: Quad AMD G34 12-core 2.3 GHz (~110 GHz) 10 Crucial RealSSD (6Gb/s) 42 WD RAID Ed. 4 2TB disks + 6Gb/s SAS expanders LSI2008S

[zfs-discuss] High-Performance ZFS (2000MB/s+)

2010-06-15 Thread Arve Paalsrud
Hi, We are currently building a storage box based on OpenSolaris/Nexenta using ZFS. Our hardware specifications are as follows: Quad AMD G34 12-core 2.3 GHz (~110 GHz) 10 Crucial RealSSD (6Gb/s) 42 WD RAID Ed. 4 2TB disks + 6Gb/s SAS expanders LSI2008SAS (two 4x ports) Mellanox InfiniBand 40 Gbi