I've sent this to the driver list as well, but since the zfs folks tend to be intimately involved with the marvell driver stack, I figured I'd give you guys a shot too.
Does anyone happen to know if there was a driver change with build 126? I had a pool that was 2x5+1 raidz vdev's. I moved all the data off temporarily, changed it to one 10+2 raidz2 vdev, and am in the process of moving all the data back. I've had two drives "fail" in the last 3 hours that have been running fine for over a year, and presented absolutely no issues moving the data out of the original zpool. My first inclination is this is a driver issue. I'm currently running 2xMarvell SAT2-MV8 SATA controllers. 6 disks on the first controller, 7 on the second (one hot spare). zpool status pool: fserv state: DEGRADED status: One or more devices has been removed by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Online the device using 'zpool online' or replace the device with 'zpool replace'. scrub: resilver completed after 1h38m with 0 errors on Sun Nov 1 18:42:16 2009 config: NAME STATE READ WRITE CKSUM fserv DEGRADED 0 0 0 raidz2-0 DEGRADED 0 0 0 c8t0d0 ONLINE 0 0 0 c8t1d0 ONLINE 0 0 0 spare-2 DEGRADED 0 0 2.83M c8t2d0 REMOVED 0 0 0 c7t6d0 ONLINE 0 0 0 35.6G resilvered c8t3d0 ONLINE 0 0 0 c8t4d0 ONLINE 0 0 0 c8t5d0 ONLINE 0 0 0 c7t0d0 ONLINE 0 0 0 c7t1d0 ONLINE 0 0 0 c7t2d0 ONLINE 0 0 0 c7t3d0 ONLINE 0 0 0 c7t4d0 REMOVED 0 0 0 c7t5d0 ONLINE 0 0 0 spares c7t6d0 INUSE currently in use Nov 1 16:21:34 fserv sata: [ID 801593 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/ pci1033,1...@0,1/pci11ab,1...@6: Nov 1 16:21:34 fserv SATA device at port 2 - device failed Nov 1 16:21:34 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0,1/pci11ab,1...@6/d...@2,0 (sd26): Nov 1 16:21:34 fserv Command failed to complete...Device is gone Nov 1 16:21:34 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0,1/pci11ab,1...@6/d...@2,0 (sd26): Nov 1 16:21:34 fserv drive offline Nov 1 16:21:34 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0,1/pci11ab,1...@6/d...@2,0 (sd26): Nov 1 16:21:34 fserv SYNCHRONIZE CACHE command failed (5) Nov 1 16:21:34 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0,1/pci11ab,1...@6/d...@2,0 (sd26): Nov 1 16:21:34 fserv drive offline Nov 1 16:21:34 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0,1/pci11ab,1...@6/d...@2,0 (sd26): Nov 1 16:21:34 fserv drive offline Nov 1 16:21:34 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0,1/pci11ab,1...@6/d...@2,0 (sd26): Nov 1 16:21:34 fserv drive offline Nov 1 16:21:34 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0,1/pci11ab,1...@6/d...@2,0 (sd26): Nov 1 16:21:34 fserv drive offline Nov 1 16:21:40 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0,1/pci11ab,1...@6/d...@2,0 (sd26): Nov 1 16:21:40 fserv drive offline Nov 1 16:21:40 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0,1/pci11ab,1...@6/d...@2,0 (sd26): Nov 1 16:21:40 fserv drive offline Nov 1 16:21:40 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0,1/pci11ab,1...@6/d...@2,0 (sd26): Nov 1 16:21:40 fserv drive offline Nov 1 16:21:40 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0,1/pci11ab,1...@6/d...@2,0 (sd26): Nov 1 16:21:40 fserv drive offline Nov 1 17:03:38 fserv marvell88sx: [ID 268337 kern.warning] WARNING: marvell88sx2:device on port 4 failed to reset Nov 1 17:04:08 fserv sata: [ID 801593 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0/pci11ab,1...@4: Nov 1 17:04:08 fserv SATA device at port 4 - device failed Nov 1 17:04:08 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0/pci11ab,1...@4/d...@4,0 (sd30): Nov 1 17:04:08 fserv Command failed to complete...Device is gone Nov 1 17:04:08 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0/pci11ab,1...@4/d...@4,0 (sd30): Nov 1 17:04:08 fserv drive offline Nov 1 17:04:09 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0/pci11ab,1...@4/d...@4,0 (sd30): Nov 1 17:04:09 fserv SYNCHRONIZE CACHE command failed (5) Nov 1 17:04:09 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0/pci11ab,1...@4/d...@4,0 (sd30): Nov 1 17:04:09 fserv drive offline Nov 1 17:04:09 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0/pci11ab,1...@4/d...@4,0 (sd30): Nov 1 17:04:09 fserv drive offline Nov 1 17:04:09 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0/pci11ab,1...@4/d...@4,0 (sd30): Nov 1 17:04:09 fserv drive offline Nov 1 17:04:09 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0/pci11ab,1...@4/d...@4,0 (sd30): Nov 1 17:04:09 fserv drive offline Nov 1 18:31:59 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0,1/pci11ab,1...@6/d...@2,0 (sd26): Nov 1 18:31:59 fserv SYNCHRONIZE CACHE command failed (5) Nov 1 18:32:11 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0,1/pci11ab,1...@6/d...@2,0 (sd26): Nov 1 18:32:11 fserv SYNCHRONIZE CACHE command failed (5) Nov 1 18:35:00 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0,1/pci11ab,1...@6/d...@2,0 (sd26): Nov 1 18:35:00 fserv SYNCHRONIZE CACHE command failed (5) Nov 1 18:35:12 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0,1/pci11ab,1...@6/d...@2,0 (sd26): Nov 1 18:35:12 fserv SYNCHRONIZE CACHE command failed (5) Nov 1 18:35:21 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0,1/pci11ab,1...@6/d...@2,0 (sd26): Nov 1 18:35:21 fserv SYNCHRONIZE CACHE command failed (5) Nov 1 18:38:36 fserv scsi: [ID 107833 kern.warning] WARNING: /p...@7c ,0/pci10de,3...@a/pci1033,1...@0,1/pci11ab,1...@6/d...@2,0 (sd26): Nov 1 18:38:36 fserv SYNCHRONIZE CACHE command failed (5) Nov 1 21:06:31 fserv pcplusmp: [ID 805372 kern.info] pcplusmp: ide (ata) instance 2 irq 0xe vector 0x44 ioapic 0x4 intin 0xe is bound to cpu 3 Nov 1 21:06:31 fserv pcplusmp: [ID 805372 kern.info] pcplusmp: ide (ata) instance 3 irq 0xf vector 0x44 ioapic 0x4 intin 0xf is bound to cpu 0
_______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss