Re: [zfs-discuss] creating a fast ZIL device for $200

2010-05-28 Thread Marty Scholes
I have a Sun A5000, 22x 73GB 15K disks in split-bus configuration, two dual 2Gb HBAs and four fibre cables from server to array, all for just under $200. The array gives 4Gb of aggregate thoughput in each direction across two 11 disk buses. Right now it is the main array, but when we outgrow it

Re: [zfs-discuss] creating a fast ZIL device for $200

2010-05-27 Thread sensille
Edward Ned Harvey wrote: >> From: sensille [mailto:sensi...@gmx.net] >> >> The only thing I'd like to point out >> is that >> ZFS doesn't do random writes on a slog, but nearly linear writes. This >> might >> even be hurting performance more than random writes, because you always >> hit >> the wors

Re: [zfs-discuss] creating a fast ZIL device for $200

2010-05-27 Thread Garrett D'Amore
On 5/27/2010 10:33 AM, sensille wrote: (resent because of received bounce) Edward Ned Harvey wrote: From: sensille [mailto:sensi...@gmx.net] So this brings me back to the question I indirectly asked in the middle of a much longer previous email - Is there some way, in software, to detect th

Re: [zfs-discuss] creating a fast ZIL device for $200

2010-05-27 Thread sensille
(resent because of received bounce) Edward Ned Harvey wrote: From: sensille [mailto:sensi...@gmx.net] So this brings me back to the question I indirectly asked in the middle of a much longer previous email - Is there some way, in software, to detect the current position of the head? If not,

Re: [zfs-discuss] creating a fast ZIL device for $200

2010-05-27 Thread sensille
(resent because of mail problems) Edward Ned Harvey wrote: From: sensille [mailto:sensi...@gmx.net] The only thing I'd like to point out is that ZFS doesn't do random writes on a slog, but nearly linear writes. This might even be hurting performance more than random writes, because you always hi

Re: [zfs-discuss] creating a fast ZIL device for $200

2010-05-27 Thread sensille
Neil Perrin wrote: > Yes, I agree this seems very appealing. I have investigated and > observed similar results. Just allocating larger intent log blocks but > only writing to say the first half of them has seen the same effect. > Despite the impressive results, we have not pursued this further mai

Re: [zfs-discuss] creating a fast ZIL device for $200

2010-05-27 Thread sensille
Richard Elling wrote: > On May 26, 2010, at 8:38 AM, Neil Perrin wrote: > >> On 05/26/10 07:10, sensille wrote: >>> My idea goes as follows: don't write linearly. Track the rotation >>> and write to the position the head will hit next. This might be done >>> by a re-mapping layer or integrated int

Re: [zfs-discuss] creating a fast ZIL device for $200

2010-05-26 Thread Richard Elling
On May 26, 2010, at 8:38 AM, Neil Perrin wrote: > On 05/26/10 07:10, sensille wrote: >> Recently, I've been reading through the ZIL/slog discussion and >> have the impression that a lot of folks here are (like me) >> interested in getting a viable solution for a cheap, fast and >> reliable ZIL dev

Re: [zfs-discuss] creating a fast ZIL device for $200

2010-05-26 Thread Neil Perrin
On 05/26/10 07:10, sensille wrote: Recently, I've been reading through the ZIL/slog discussion and have the impression that a lot of folks here are (like me) interested in getting a viable solution for a cheap, fast and reliable ZIL device. I think I can provide such a solution for about $200, bu

Re: [zfs-discuss] creating a fast ZIL device for $200

2010-05-26 Thread sensille
Bob Friesenhahn wrote: > On Wed, 26 May 2010, sensille wrote: >> The basic idea: the main problem when using a HDD as a ZIL device >> are the cache flushes in combination with the linear write pattern >> of the ZIL. This leads to a whole rotation of the platter after >> each write, because after th

Re: [zfs-discuss] creating a fast ZIL device for $200

2010-05-26 Thread Bob Friesenhahn
On Wed, 26 May 2010, sensille wrote: The basic idea: the main problem when using a HDD as a ZIL device are the cache flushes in combination with the linear write pattern of the ZIL. This leads to a whole rotation of the platter after each write, because after the first write returns, the head is

Re: [zfs-discuss] creating a fast ZIL device for $200

2010-05-26 Thread Tomas Ă–gren
On 26 May, 2010 - sensille sent me these 4,5K bytes: > Edward Ned Harvey wrote: > >> From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- > >> boun...@opensolaris.org] On Behalf Of sensille > >> > >> The basic idea: the main problem when using a HDD as a ZIL device > >> are the cache flu

Re: [zfs-discuss] creating a fast ZIL device for $200

2010-05-26 Thread sensille
Edward Ned Harvey wrote: >> From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- >> boun...@opensolaris.org] On Behalf Of sensille >> >> The basic idea: the main problem when using a HDD as a ZIL device >> are the cache flushes in combination with the linear write pattern >> of the ZIL. T

Re: [zfs-discuss] creating a fast ZIL device for $200

2010-05-26 Thread Edward Ned Harvey
> From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- > boun...@opensolaris.org] On Behalf Of sensille > > The basic idea: the main problem when using a HDD as a ZIL device > are the cache flushes in combination with the linear write pattern > of the ZIL. This leads to a whole rotation