Re: [zfs-discuss] NFS/ZFS slow on parallel writes

2009-10-30 Thread Bernd Nies
Hi, Just for closing this topic. Two issues have been found which caused the slow write performance on our Sun Storage 7410 with RAIDZ2: (1) A Opensolaris bug when NFS mount option is set to wsize=32768. Reducing to wsize=16384 resulted in a performance gain of about factor 2. http://bugs.ope

Re: [zfs-discuss] NFS/ZFS slow on parallel writes

2009-09-29 Thread Bernd Nies
Hi Bob, > Striping across two large raidz2s is not ideal for > multi-user use. > You are getting the equivalent of two disks worth of > IOPS, which does > not go very far. More smaller raidz vdevs or mirror > vdevs would be > better. Also, make sure that you have plenty of RAM > installed. Th

Re: [zfs-discuss] NFS/ZFS slow on parallel writes

2009-09-29 Thread Richard Elling
On Sep 29, 2009, at 7:59 AM, Bernd Nies wrote: Hi, The system already has a SSD (ATASTECZeusIOPS018GBytesSTMD905C) as ZFS log device. I apologize, I should know better than to answer before the first cup of coffee :-P NFS writes from only one host are not the problem. Even with may s

Re: [zfs-discuss] NFS/ZFS slow on parallel writes

2009-09-29 Thread Mika Borner
Bob Friesenhahn wrote: Striping across two large raidz2s is not ideal for multi-user use. You are getting the equivalent of two disks worth of IOPS, which does not go very far. More smaller raidz vdevs or mirror vdevs would be better. Also, make sure that you have plenty of RAM installed. F

Re: [zfs-discuss] NFS/ZFS slow on parallel writes

2009-09-29 Thread Bob Friesenhahn
On Tue, 29 Sep 2009, Bernd Nies wrote: NFS writes from only one host are not the problem. Even with may small files it is almost as fast as a Netapp. Problem arises when doing the same parallel from n hosts. E.g. the same write from 10 hosts lasts 10 times longer. On the Netapp the same from

Re: [zfs-discuss] NFS/ZFS slow on parallel writes

2009-09-29 Thread Bernd Nies
Hi, The system already has a SSD (ATASTECZeusIOPS018GBytesSTMD905C) as ZFS log device. NFS writes from only one host are not the problem. Even with may small files it is almost as fast as a Netapp. Problem arises when doing the same parallel from n hosts. E.g. the same write from 10 hosts

Re: [zfs-discuss] NFS/ZFS slow on parallel writes

2009-09-29 Thread Ross Walker
On Tue, Sep 29, 2009 at 10:35 AM, Richard Elling wrote: > > On Sep 29, 2009, at 2:03 AM, Bernd Nies wrote: > >> Hi, >> >> We have a Sun Storage 7410 with the latest release (which is based upon >> opensolaris). The system uses a hybrid storage pool (23 1TB SATA disks in >> RAIDZ2 and 1 18GB SSD as

Re: [zfs-discuss] NFS/ZFS slow on parallel writes

2009-09-29 Thread Richard Elling
On Sep 29, 2009, at 2:03 AM, Bernd Nies wrote: Hi, We have a Sun Storage 7410 with the latest release (which is based upon opensolaris). The system uses a hybrid storage pool (23 1TB SATA disks in RAIDZ2 and 1 18GB SSD as log device). The ZFS volumes are exported with NFSv3 over TCP. NFS

[zfs-discuss] NFS/ZFS slow on parallel writes

2009-09-29 Thread Bernd Nies
Hi, We have a Sun Storage 7410 with the latest release (which is based upon opensolaris). The system uses a hybrid storage pool (23 1TB SATA disks in RAIDZ2 and 1 18GB SSD as log device). The ZFS volumes are exported with NFSv3 over TCP. NFS mount options are: rw,bg,vers=3,proto=tcp,hard,intr,