I am having trouble getting ZFS to behave as I would expect. I am using the HP driver (cpqary3) for the Smart Array P400 (in a HP Proliant DL385 G2) with 10k 2.5" 146GB SAS drives. The drives appear correctly, however due to the controller not offering JBOD functionality I had to configure each drive as a RAID0 logical drive.
Everything appears to work fine, the drives are detected and I created a mirror for the OS to install to and an additional raidz2 array with the remaining 6 discs. But when I remove a disc and then reinsert it I cannot get ZFS to accept it back into the array see bellow for the details. I thought it might be a problem with using the whole discs eg: c1t*d0 so I created a single partition on each and used that, but had the same results. The module seem to detect the drive has been reinserted successfully but the OS doesn't seem to want to write to it. Any help would be most appreciated as I would much prefer to use ZFS's software capabilities rather than the hardware card in the machine. When rebooting the system the Array BIOS also displays some interesting behavior. ### BIOS Output 1792-Slot 1 Drive Array - Valid Data Found in the Array Accelerator Data will automatically be written to the drive array 1779-Slot 1 Drive Array - Replacement drive(s) detected OR previously failed drives(s) no appear to be operational POrt 2I: Box1: Bay3 Logical drives(s) disabled due to possible data loss. Select "F1" to continue with logical drive(s) disabled Select "F2" to accept data loss and to re-enable logical drive(s) #### Terminal output bash-3.00# zpool status test pool: test state: DEGRADED status: One or more devices could not be opened. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Attach the missing device and online it using 'zpool online'. see: http://www.sun.com/msg/ZFS-8000-2Q scrub: resilver completed after 0h0m with 0 errors on Tue Jan 27 03:30:16 2009 config: NAME STATE READ WRITE CKSUM test DEGRADED 0 0 0 raidz2 DEGRADED 0 0 0 c1t2d0p0 ONLINE 0 0 0 c1t3d0p0 ONLINE 0 0 0 c1t4d0p0 ONLINE 0 0 0 c1t5d0p0 UNAVAIL 0 0 0 cannot open c1t6d0p0 ONLINE 0 0 0 c1t8d0p0 ONLINE 0 0 0 errors: No known data errors bash-3.00# zpool online test c1t5d0p0 warning: device 'c1t5d0p0' onlined, but remains in faulted state use 'zpool replace' to replace devices that are no longer present bash-3.00# dmesg Jan 27 03:27:40 unknown cpqary3: [ID 823470 kern.notice] NOTICE: Smart Array P400 Controller Jan 27 03:27:40 unknown cpqary3: [ID 823470 kern.notice] Hot-plug drive inserted, Port: 2I Box: 1 Bay: 3 Jan 27 03:27:40 unknown cpqary3: [ID 479030 kern.notice] Configured Drive ? ....... YES Jan 27 03:27:40 unknown cpqary3: [ID 100000 kern.notice] Jan 27 03:27:40 unknown cpqary3: [ID 823470 kern.notice] NOTICE: Smart Array P400 Controller Jan 27 03:27:40 unknown cpqary3: [ID 834734 kern.notice] Media exchange detected, logical drive 6 Jan 27 03:27:40 unknown cpqary3: [ID 100000 kern.notice] ... Jan 27 03:36:24 unknown scsi: [ID 107833 kern.warning] WARNING: /p...@38,0/pci1166,1...@10/pci103c,3...@0/s...@5,0 (sd6): Jan 27 03:36:24 unknown SYNCHRONIZE CACHE command failed (5) ... Jan 27 03:47:58 unknown scsi: [ID 107833 kern.warning] WARNING: /p...@38,0/pci1166,1...@10/pci103c,3...@0/s...@5,0 (sd6): Jan 27 03:47:58 unknown drive offline -- This message posted from opensolaris.org _______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
