On Nov 17, 2007 2:55 PM, Torrey McMahon <[EMAIL PROTECTED]> wrote: > Have you tried disabling the zil cache flushing?
I already have zfs nocache flush set to 1 to take advantage of NVRAM of the raid controllers set zfs:zfs_nocacheflush = 1 > > http://www.solarisinternals.com/wiki/index.php/ZFS_Evil_Tuning_Guide#Cache_Flushes > > > Asif Iqbal wrote: > > (Including storage-discuss) > > > > I have 6 6140s with 96 disks. Out of which 64 of them are Seagate > > ST3300007FC (300GB - 10000 RPM FC-AL) > > > > I created 16k seg size raid0 luns using single fcal disks. Then > > created a zpool with 8 4+1 raidz1 using those luns, out of single > > disks. Also set the zfs nocache flush to `1' to > > take advantage of the 2G NVRAM cache of the controllers. > > > > I am using one port per controller. Rest of them are down (not in > > use). Each controller port > > speed is 4Gbps. > > > > All luns have one controller as primary and second one as secondary > > > > I am getting only 125MB/s according to the zpool IO. > > > > I should get ~ 512MB/s per IO. > > > > Also is it possible to get 2GB/s IO by using the leftover ports of the > > controllers? > > > > Is it also possible to get 4GB/s IO by aggregating the controllers (w/ > > 8 ports totat)? > > > > > > > > On Nov 16, 2007 5:30 PM, Asif Iqbal <[EMAIL PROTECTED]> wrote: > > > >> I have the following layout > >> > >> A 490 with 8 1.8Ghz and 16G mem. 6 6140s with 2 FC controllers using > >> A1 anfd B1 controller port 4Gbps speed. > >> Each controller has 2G NVRAM > >> > >> On 6140s I setup raid0 lun per SAS disks with 16K segment size. > >> > >> On 490 I created a zpool with 8 4+1 raidz1s > >> > >> I am getting zpool IO of only 125MB/s with zfs:zfs_nocacheflush = 1 in > >> /etc/system > >> > >> Is there a way I can improve the performance. I like to get 1GB/sec IO. > >> > >> Currently each lun is setup as primary A1 and secondary B1 or vice versa > >> > >> I also have write cache eanble according to CAM > >> > >> -- > >> Asif Iqbal > >> PGP Key: 0xE62693C5 KeyServer: pgp.mit.edu > >> > >> > > > > > > > > > > -- Asif Iqbal PGP Key: 0xE62693C5 KeyServer: pgp.mit.edu _______________________________________________ perf-discuss mailing list perf-discuss@opensolaris.org
