Re: [zfs-discuss] Dealing with Single Bit Flips - WAS: Cause for data corruption?

2008-03-03 Thread Nathan Kroenert
Hey, Bob My perspective on Big reasons for it *to* be integrated would be: - It's tested - By the folks charged with making ZFS good - It's kept in sync with the differing Zpool versions - It's documented - When the system *is* patched, any changes the patch brings are synced with the rec

Re: [zfs-discuss] Dealing with Single Bit Flips - WAS: Cause for data corruption?

2008-03-03 Thread Boyd Adamson
Nathan Kroenert <[EMAIL PROTECTED]> writes: > Bob Friesenhahn wrote: >> On Tue, 4 Mar 2008, Nathan Kroenert wrote: >>> >>> It does seem that some of us are getting a little caught up in disks >>> and their magnificence in what they write to the platter and read >>> back, and overlooking the poten

Re: [zfs-discuss] Dealing with Single Bit Flips - WAS: Cause for data corruption?

2008-03-03 Thread Bob Friesenhahn
On Tue, 4 Mar 2008, Nathan Kroenert wrote: >> The circus trick can be handled via a user-contributed utility. In fact, >> people can compete with their various repair utilities. There are only >> 1048576 1-bit permuations to try, and then the various two-bit permutations >> can be tried. > > T

Re: [zfs-discuss] Dealing with Single Bit Flips - WAS: Cause for data corruption?

2008-03-03 Thread Nathan Kroenert
Bob Friesenhahn wrote: > On Tue, 4 Mar 2008, Nathan Kroenert wrote: >> >> It does seem that some of us are getting a little caught up in disks >> and their magnificence in what they write to the platter and read >> back, and overlooking the potential value of a simple (though >> potentially comp

Re: [zfs-discuss] Dealing with Single Bit Flips - WAS: Cause for data corruption?

2008-03-03 Thread Bob Friesenhahn
On Tue, 4 Mar 2008, Nathan Kroenert wrote: > > It does seem that some of us are getting a little caught up in disks and > their magnificence in what they write to the platter and read back, and > overlooking the potential value of a simple (though potentially > computationally expensive) circus

Re: [zfs-discuss] Mirroring to a smaller disk

2008-03-03 Thread Patrick Bachmann
Jonathan, On Mon, Mar 03, 2008 at 11:14:14AM -0800, Jonathan Loran wrote: > What I'm left with now is to do more expensive modifications to the new > mirror to increase its size, or using zfs send | receive or rsync to > copy the data, and have an extended down time for our users. Yuck! Not su

Re: [zfs-discuss] Dealing with Single Bit Flips - WAS: Cause for data corruption?

2008-03-03 Thread Nathan Kroenert
Hey, Bob, Though I have already got the answer I was looking for here, I thought I'd at least take the time to provide my point of view as to my *why*... First: I don't think any of us have forgotten the goodness that ZFS's checksum *can* bring. I'm also keenly aware that we have some customer

Re: [zfs-discuss] Mirroring to a smaller disk

2008-03-03 Thread Jonathan Loran
Shawn Ferry wrote: On Mar 3, 2008, at 2:14 PM, Jonathan Loran wrote: Now I know this is counterculture, but it's biting me in the back side right now, and ruining my life. I have a storage array (iSCSI SAN) that is performing badly, and requires some upgrades/reconfiguration. I have a se

Re: [zfs-discuss] Mirroring to a smaller disk

2008-03-03 Thread Shawn Ferry
On Mar 3, 2008, at 2:14 PM, Jonathan Loran wrote: > > Now I know this is counterculture, but it's biting me in the back side > right now, and ruining my life. > > I have a storage array (iSCSI SAN) that is performing badly, and > requires some upgrades/reconfiguration. I have a second storage ar

[zfs-discuss] Mirroring to a smaller disk

2008-03-03 Thread Jonathan Loran
Now I know this is counterculture, but it's biting me in the back side right now, and ruining my life. I have a storage array (iSCSI SAN) that is performing badly, and requires some upgrades/reconfiguration. I have a second storage array that I wanted to set up as a ZFS mirror so I could fre

Re: [zfs-discuss] Dealing with Single Bit Flips - WAS: Cause for data corruption?

2008-03-03 Thread Richard Elling
Bob Friesenhahn wrote: > On Mon, 3 Mar 2008, Darren J Moffat wrote: > > >>> I'm not convinced that single bit flips are the common >>> failure mode for disks. Most enterprise class disks already >>> have enough ECC to correct at least 8 bytes per block. >>> >> and for consumer rather tha

Re: [zfs-discuss] Dealing with Single Bit Flips - WAS: Cause for data corruption?

2008-03-03 Thread Bob Friesenhahn
On Mon, 3 Mar 2008, Darren J Moffat wrote: >> I'm not convinced that single bit flips are the common >> failure mode for disks. Most enterprise class disks already >> have enough ECC to correct at least 8 bytes per block. > > and for consumer rather than enterprise class disks ? You are assumin

Re: [zfs-discuss] Newbie question removing disk

2008-03-03 Thread Tim
On 3/3/08, John R. Sconiers II <[EMAIL PROTECTED]> wrote: > > Hi, > New user question. In ZFS (solaris 10) are we able to "evacuate" a disk > if I later decide to remove it from a ZFS pool. I know the answer use > to be no but I'm not sure if that has changed or will change. > JOHN > > -- > *

Re: [zfs-discuss] Newbie question removing disk

2008-03-03 Thread Tim
On 3/3/08, John R. Sconiers II <[EMAIL PROTECTED]> wrote: > > Hi, > New user question. In ZFS (solaris 10) are we able to "evacuate" a disk > if I later decide to remove it from a ZFS pool. I know the answer use > to be no but I'm not sure if that has changed or will change. > JOHN > > -- > *

Re: [zfs-discuss] Dealing with Single Bit Flips - WAS: Causefor data corruption?

2008-03-03 Thread Gary Mills
On Mon, Mar 03, 2008 at 08:27:08AM -0800, Richard Elling wrote: > me wrote: > >> All that said, I'm still occasionally tempted to bring it back. > >> It may become more relevant with flash memory as a storage medium. > > > > How common would be single on-disk bit flips in 128K blocks? > > Most ent

Re: [zfs-discuss] Dealing with Single Bit Flips - WAS: Cause for

2008-03-03 Thread MC
> I'm not convinced that single bit flips are the common failure mode for disks. I think the original suggestion might be for bad RAM more than bad disks. Just about every home computer does not have ECC RAM, so as ZFS transitions from enterprise to home, this (optional) feature sounds very wor

Re: [zfs-discuss] Dealing with Single Bit Flips - WAS: Cause for data corruption?

2008-03-03 Thread Richard Elling
Darren J Moffat wrote: > Jeff Bonwick wrote: > >> All that said, I'm still occasionally tempted to bring it back. >> It may become more relevant with flash memory as a storage medium. >> > > Would it be worth considering bring it back as part of zdb rather than > part of the core zio layer

Re: [zfs-discuss] Dealing with Single Bit Flips - WAS: Cause for data corruption?

2008-03-03 Thread Darren J Moffat
Richard Elling wrote: > Darren J Moffat wrote: >> Jeff Bonwick wrote: >> >>> All that said, I'm still occasionally tempted to bring it back. >>> It may become more relevant with flash memory as a storage medium. >>> >> Would it be worth considering bring it back as part of zdb rather than

[zfs-discuss] Newbie question removing disk

2008-03-03 Thread John R. Sconiers II
Hi, New user question. In ZFS (solaris 10) are we able to "evacuate" a disk if I later decide to remove it from a ZFS pool. I know the answer use to be no but I'm not sure if that has changed or will change. JOHN -- * John R. Sconiers II

Re: [zfs-discuss] Dealing with Single Bit Flips - WAS: Causefor data corruption?

2008-03-03 Thread Richard Elling
me wrote: >> All that said, I'm still occasionally tempted to bring it back. >> It may become more relevant with flash memory as a storage medium. >> > > How common would be single on-disk bit flips in 128K blocks? Disk > manufacturers quantized it as a 1 to 10 to the power of god knows what,

Re: [zfs-discuss] Dealing with Single Bit Flips - WAS: Ca usefor data corruption?

2008-03-03 Thread Bob Friesenhahn
On Mon, 3 Mar 2008, me wrote: > I'm sure people using no redundancy (e.g. future OSX users) would > appreciate it, saving some grief if the bad blocks are indeed just > single bit flips. In case people have somehow forgotten, most other filesystems in common use do not checksum data blocks. I

Re: [zfs-discuss] zfs send vs. cp

2008-03-03 Thread Roch Bourbonnais
Le 3 mars 08 à 09:58, Robert Milkowski a écrit : > Hello zfs-discuss, > > > I had a zfs file system with recordsize=8k and a couple of large > files. While doing zfs send | zfs recv I noticed it's doing > about 1500 IOPS but with block size 8K so total throughput > wasn't impr

Re: [zfs-discuss] Dealing with Single Bit Flips - WAS: Ca usefor data corruption?

2008-03-03 Thread me
> All that said, I'm still occasionally tempted to bring it back. > It may become more relevant with flash memory as a storage medium. How common would be single on-disk bit flips in 128K blocks? Disk manufacturers quantized it as a 1 to 10 to the power of god knows what, which practically means

Re: [zfs-discuss] Dealing with Single Bit Flips - WAS: Cause for data corruption?

2008-03-03 Thread Darren J Moffat
Jeff Bonwick wrote: > All that said, I'm still occasionally tempted to bring it back. > It may become more relevant with flash memory as a storage medium. Would it be worth considering bring it back as part of zdb rather than part of the core zio layer ? -- Darren J Moffat _

[zfs-discuss] zfs send vs. cp

2008-03-03 Thread Robert Milkowski
Hello zfs-discuss, I had a zfs file system with recordsize=8k and a couple of large files. While doing zfs send | zfs recv I noticed it's doing about 1500 IOPS but with block size 8K so total throughput wasn't impressive. So I stopped it and tried to cp files from a