System specifications please? On 1/25/07, ComCept Net GmbH Soliva <[EMAIL PROTECTED]> wrote:
Hellonow I was configuring my syste with RaidZ and with Spares (explained below). I would like to test the configuration it means after successful config of ZFS I pulled-out a disk of one of the RaidZ's. Imidiately the system brought up on the console: Jan 25 09:08:46 global-one scsi: WARNING: /[EMAIL PROTECTED],4000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0 (sd38): Jan 25 09:08:46 global-one disk not responding to selection After a few seconds the Console was freezed and also over ssh not chance to login again. At least I powered off and on the system. As the system was up again (without errors) I logged in again and looked to the zpool: # zpool status -x zfs-pool pool: zfs-pool state: DEGRADED status: One or more devices could not be opened. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Attach the missing device and online it using 'zpool online'. see: http://www.sun.com/msg/ZFS-8000-D3 scrub: none requested config: NAME STATE READ WRITE CKSUM zfs-pool DEGRADED 0 0 0 raidz1 DEGRADED 0 0 0 c0t2d0 ONLINE 0 0 0 c2t1d0 ONLINE 0 0 0 c2t3d0 UNAVAIL 0 0 0 cannot open c3t1d0 ONLINE 0 0 0 raidz1 ONLINE 0 0 0 c0t1d0 ONLINE 0 0 0 c0t3d0 ONLINE 0 0 0 c2t2d0 ONLINE 0 0 0 c3t0d0 ONLINE 0 0 0 spares c3t2d0 AVAIL c3t3d0 AVAIL errors: No known data errors I was going a little bit through the forum and found a similar issue: http://www.opensolaris.org/jive/thread.jspa?threadID=22487&tstart=0 Is my test to pullout a disk not visible? Is there a bug in ZFS like mentioned by in the above threadID22487? I do not understand the reaction of the system and I do not find any logs which points to a issue except the console message depending the disk? Did I do something wrong? That we understand us correct if I bring the Disk again online all is fine but it could not be that if a disk fails that the overall system goes down or......? Below the documentation what I did: Many thanks for any help! Andrea -------- ZFS CONFIG on Solaris Sparc 11/06 (without any patch)--------- system SUNWadmr System & Network Administration Root system SUNWarc Lint Libraries (usr) system SUNWatfsr AutoFS, (Root) system SUNWatfsu AutoFS, (Usr) system SUNWbcp SunOS 4.x Binary Compatibility system SUNWbip Basic IP commands (Usr) system SUNWbipr Basic IP commands (Root) system SUNWbtool CCS tools bundled with SunOS system SUNWbzip The bzip compression utility system SUNWcakr Core Solaris Kernel Architecture (Root) system SUNWcar Core Architecture, (Root) system SUNWcfpl fp cfgadm plug-in library system SUNWcfplr fp cfgadm plug-in library (root) system SUNWchxge Chelsio N110 10GE NIC Driver system SUNWckr Core Solaris Kernel (Root) system SUNWcnetr Core Solaris Network Infrastructure (Root) system SUNWcpp Solaris cpp system SUNWcsd Core Solaris Devices system SUNWcsl Core Solaris, (Shared Libs) system SUNWcslr Core Solaris Libraries (Root) system SUNWcsr Core Solaris, (Root) system SUNWcsu Core Solaris, (Usr) system SUNWerid Sun RIO 10/100 Mb Ethernet Drivers system SUNWesu Extended System Utilities system SUNWfcip Sun FCIP IP/ARP over FibreChannel Device Driver system SUNWfcp Sun FCP SCSI Device Driver system SUNWfctl Sun Fibre Channel Transport layer system SUNWflexruntime Flex Lexer (Runtime Libraries) system SUNWgss GSSAPI V2 system SUNWgssc GSSAPI CONFIG V2 system SUNWgzip The GNU Zip (gzip) compression utility system SUNWhea SunOS Header Files system SUNWhmd SunSwift Adapter Drivers system SUNWib Sun InfiniBand Framework system SUNWinstall-patch-utils-root Install and Patch Utilities (root) system SUNWipc Interprocess Communications system SUNWipoib Sun IP over InfiniBand system SUNWjss Network Security Services for Java (JSS) system SUNWkey Keyboard configuration tables system SUNWkvm Core Architecture, (Kvm) system SUNWlexpt libexpat - XML parser library system SUNWlibC Sun Workshop Compilers Bundled libC system SUNWlibm Math & Microtasking Library Headers & Lint Files (Usr) system SUNWlibmr Math Library Lint Files (Root) system SUNWlibms Math & Microtasking Libraries (Usr) system SUNWlibmsr Math & Microtasking Libraries (Root) system SUNWlibsasl SASL v2 system SUNWloc System Localization system SUNWlxml The XML library system SUNWmdb Modular Debugger system SUNWmdr Solaris Volume Manager, (Root) system SUNWmdu Solaris Volume Manager, (Usr) system SUNWmpathadm Solaris Multipathing CLI system SUNWmpathadmr Solaris Multipathing CLI (Root) system SUNWmpsvplr Sun MP API library for the scsi_vhci driver (Root) system SUNWnfscr Network File System (NFS) client support (Root) system SUNWnfscu Network File System (NFS) client support (Usr) system SUNWopenssl-libraries OpenSSL Libraries (Usr) system SUNWowbcp OpenWindows binary compatibility system SUNWpd PCI Drivers system SUNWperl584core Perl 5.8.4 (core) system SUNWperl584usr Perl 5.8.4 (non-core) system SUNWpkgcmdsr SVr4 package commands (root) system SUNWpkgcmdsu SVr4 packaging commands (usr) system SUNWpr Netscape Portable Runtime system SUNWproduct-registry-root Solaris Product Registry runtime support (root) system SUNWqfed Sun Quad FastEthernet Adapter Driver system SUNWrmodu Realmode Modules, (Usr) system SUNWroute Network Routing daemons/commands (Usr) system SUNWscbcp SPARCompilers Binary Compatibility Libraries system SUNWscpr Source Compatibility, (Root) system SUNWscpu Source Compatibility, (Usr) system SUNWsmapi Storage Management APIs system SUNWsprot Solaris Bundled tools system SUNWsshcu SSH Common, (Usr) system SUNWsshdr SSH Server, (Root) system SUNWsshdu SSH Server, (Usr) system SUNWsshr SSH Client and utilities, (Root) system SUNWsshu SSH Client and utilities, (Usr) system SUNWswmt Install and Patch Utilities system SUNWtavor Sun Tavor HCA driver system SUNWtecla Tecla command-line editing library system SUNWtls Network Security Services system SUNWtoo Programming Tools system SUNWudapltr Sun uDAPL for Tavor (Root) system SUNWudapltu Sun uDAPL for Tavor (User) system SUNWwbsup WAN boot support system SUNWwsr2 Solaris Product Registry & Web Start runtime support system SUNWzfskr ZFS Kernel (Root) system SUNWzfsr ZFS (Root) system SUNWzfsu ZFS (Usr) system SUNWzlib The Zip compression library STATE STIME FMRI legacy_run 9:40:27 lrc:/etc/rc2_d/S20sysetup legacy_run 9:40:27 lrc:/etc/rc2_d/S81dodatadm_udaplt legacy_run 9:40:27 lrc:/etc/rc2_d/S98deallocate online 9:39:54 svc:/system/svc/restarter:default online 9:39:56 svc:/network/loopback:default online 9:39:57 svc:/system/filesystem/root:default online 9:39:57 svc:/network/physical:default online 9:39:58 svc:/milestone/name-services:default online 9:39:58 svc:/system/scheduler:default online 9:39:58 svc:/milestone/network:default online 9:39:58 svc:/system/boot-archive:default online 9:39:59 svc:/system/identity:node online 9:40:03 svc:/system/filesystem/usr:default online 9:40:04 svc:/system/keymap:default online 9:40:20 svc:/system/device/local:default online 9:40:21 svc:/system/filesystem/minimal:default online 9:40:21 svc:/system/sysevent:default online 9:40:21 svc:/system/identity:domain online 9:40:21 svc:/system/rmtmpfiles:default online 9:40:22 svc:/system/device/fc-fabric:default online 9:40:22 svc:/milestone/devices:default online 9:40:22 svc:/system/coreadm:default online 9:40:22 svc:/system/cryptosvc:default online 9:40:24 svc:/system/manifest-import:default online 9:40:24 svc:/network/initial:default online 9:40:24 svc:/milestone/single-user:default online 9:40:24 svc:/network/service:default online 9:40:25 svc:/system/filesystem/local:default online 9:40:25 svc:/system/sysidtool:net online 9:40:25 svc:/system/cron:default online 9:40:25 svc:/milestone/sysconfig:default online 9:40:25 svc:/system/sac:default online 9:40:26 svc:/system/dumpadm:default online 9:40:26 svc:/system/utmp:default online 9:40:26 svc:/system/console-login:default online 9:40:26 svc:/network/rpc/bind:default online 9:40:26 svc:/system/system-log:default online 9:40:27 svc:/network/inetd:default online 9:40:27 svc:/network/rpc/keyserv:default online 9:40:28 svc:/network/ssh:default online 9:40:28 svc:/milestone/multi-user:default online 9:40:28 svc:/milestone/multi-user-server:default Disk to be configured in zpool for Zones (no Zones yet configured)! c0t2d0 --> RaidZ Set1 c2t1d0 --> RaidZ Set1 c2t3d0 --> RaidZ Set1 c3t1d0 --> RaidZ Set1 c0t1d0 --> RaidZ Set2 c0t3d0 --> RaidZ Set2 c2t2d0 --> RaidZ Set2 c3t0d0 --> RaidZ Set2 c3t2d0 --> Spare RaidZ Set1/2 c3t3d0 --> Spare RaidZ Set1/2 # zpool create -fm /zfs-pool zfs-pool raidz c0t2d0 c2t1d0 c2t3d0 c3t1d0 raidz c0t1d0 c0t3d0 c2t2d0 c3t0d0 # zpool status zfs-pool pool: zfs-pool state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM zfs-pool ONLINE 0 0 0 raidz1 ONLINE 0 0 0 c0t2d0 ONLINE 0 0 0 c2t1d0 ONLINE 0 0 0 c2t3d0 ONLINE 0 0 0 c3t1d0 ONLINE 0 0 0 raidz1 ONLINE 0 0 0 c0t1d0 ONLINE 0 0 0 c0t3d0 ONLINE 0 0 0 c2t2d0 ONLINE 0 0 0 c3t0d0 ONLINE 0 0 0 errors: No known data errors # zpool list zfs-pool NAME SIZE USED AVAIL CAP HEALTH ALTROOT zfs-pool 134G 149K 134G 0% ONLINE - # zpool add -f zfs-pool spare c3t2d0 c3t3d0 # zpool status zfs-pool pool: zfs-pool state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM zfs-pool ONLINE 0 0 0 raidz1 ONLINE 0 0 0 c0t2d0 ONLINE 0 0 0 c2t1d0 ONLINE 0 0 0 c2t3d0 ONLINE 0 0 0 c3t1d0 ONLINE 0 0 0 raidz1 ONLINE 0 0 0 c0t1d0 ONLINE 0 0 0 c0t3d0 ONLINE 0 0 0 c2t2d0 ONLINE 0 0 0 c3t0d0 ONLINE 0 0 0 spares c3t2d0 AVAIL c3t3d0 AVAIL # zfs get mountpoint zfs-pool NAME PROPERTY VALUE SOURCE zfs-pool mountpoint /zfs-pool local # zfs set mountpoint=legacy zfs-pool # vi /etc/vfstab --------------- /etc/vfstab --------------- #device device mount FS fsck mount mount #to mount to fsck point type pass at boot options # zfs-pool - /zfs-pool zfs - yes - --------------- /etc/vfstab --------------- # zpool scrub zfs-pool # zpool status -v zfs-pool pool: zfs-pool state: ONLINE scrub: scrub completed with 0 errors on Wed Jan 24 18:16:09 2007 config: NAME STATE READ WRITE CKSUM zfs-pool ONLINE 0 0 0 raidz1 ONLINE 0 0 0 c0t2d0 ONLINE 0 0 0 c2t1d0 ONLINE 0 0 0 c2t3d0 ONLINE 0 0 0 c3t1d0 ONLINE 0 0 0 raidz1 ONLINE 0 0 0 c0t1d0 ONLINE 0 0 0 c0t3d0 ONLINE 0 0 0 c2t2d0 ONLINE 0 0 0 c3t0d0 ONLINE 0 0 0 spares c3t2d0 AVAIL c3t3d0 AVAIL errors: No known data errors # zfs create zfs-pool/zone-1 # zfs create zfs-pool/zone-2 # zfs list NAME USED AVAIL REFER MOUNTPOINT zfs-pool 199K 98.7G 36.7K legacy zfs-pool/zone-1 36.7K 98.7G 36.7K legacy zfs-pool/zone-2 36.7K 98.7G 36.7K legacy # zfs get mountpoint zfs-pool/zone-1 NAME PROPERTY VALUE SOURCE zfs-pool/zone-1 mountpoint legacy inherited from zfs-pool # zfs get mountpoint zfs-pool/zone-1 NAME PROPERTY VALUE SOURCE zfs-pool/zone-2 mountpoint legacy inherited from zfs-pool # vi /etc/vfstab --------------- /etc/vfstab --------------- #device device mount FS fsck mount mount #to mount to fsck point type pass at boot options # zfs-pool - /zfs-pool zfs - yes - zfs-pool/zone-1 - /zfs-pool/zone-1 zfs - yes - zfs-pool/zone-2 - /zfs-pool/zone-2 zfs - yes - --------------- /etc/vfstab --------------- # mkdir /zfs-pool/zone-1 # mkdir /zfs-pool/zone-2 # mount /zfs-pool/zone-1 # mount /zfs-pool/zone-2 or # mount -F zfs /zfs-pool/zone-1 # mount -F zfs /zfs-pool/zone-2 # df -h Filesystem size used avail capacity Mounted on /dev/dsk/c0t0d0s0 4.3G 231M 4.1G 6% / /devices 0K 0K 0K 0% /devices ctfs 0K 0K 0K 0% /system/contract proc 0K 0K 0K 0% /proc mnttab 0K 0K 0K 0% /etc/mnttab swap 4.6G 592K 4.6G 1% /etc/svc/volatile objfs 0K 0K 0K 0% /system/object fd 0K 0K 0K 0% /dev/fd /dev/dsk/c0t0d0s1 994M 5.7M 929M 1% /var swap 4.6G 0K 4.6G 0% /tmp swap 4.6G 24K 4.6G 1% /var/run zfs-pool 99G 39K 99G 1% /zfs-pool zfs-pool/zone-1 99G 36K 99G 1% /zfs-pool/zone-1 zfs-pool/zone-2 99G 36K 99G 1% /zfs-pool/zone-2 # zfs get all zfs-pool/zone-1 NAME PROPERTY VALUE SOURCE zfs-pool/zone-1 type filesystem - zfs-pool/zone-1 creation Thu Jan 25 7:51 2007 - zfs-pool/zone-1 used 36.7K - zfs-pool/zone-1 available 98.7G - zfs-pool/zone-1 referenced 36.7K - zfs-pool/zone-1 compressratio 1.00x - zfs-pool/zone-1 mounted yes - zfs-pool/zone-1 quota none default zfs-pool/zone-1 reservation none default zfs-pool/zone-1 recordsize 128K default zfs-pool/zone-1 mountpoint legacy inherited from zfs-pool zfs-pool/zone-1 sharenfs off default zfs-pool/zone-1 checksum on default zfs-pool/zone-1 compression off default zfs-pool/zone-1 atime on default zfs-pool/zone-1 devices on default zfs-pool/zone-1 exec on default zfs-pool/zone-1 setuid on default zfs-pool/zone-1 readonly off default zfs-pool/zone-1 zoned off default zfs-pool/zone-1 snapdir hidden default zfs-pool/zone-1 aclmode groupmask default zfs-pool/zone-1 aclinherit secure default # zfs get compression zfs-pool/zone-1 NAME PROPERTY VALUE SOURCE zfs-pool/zone-1 compression on local # zpool status zfs-pool pool: zfs-pool state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM zfs-pool ONLINE 0 0 0 raidz1 ONLINE 0 0 0 c0t2d0 ONLINE 0 0 0 c2t1d0 ONLINE 0 0 0 c2t3d0 ONLINE 0 0 0 c3t1d0 ONLINE 0 0 0 raidz1 ONLINE 0 0 0 c0t1d0 ONLINE 0 0 0 c0t3d0 ONLINE 0 0 0 c2t2d0 ONLINE 0 0 0 c3t0d0 ONLINE 0 0 0 spares c3t2d0 AVAIL c3t3d0 AVAIL Pull-out Disk "c2t3d0" Jan 25 09:08:46 global-one scsi: WARNING: /[EMAIL PROTECTED],4000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0 (sd38): Jan 25 09:08:46 global-one disk not responding to selection # zpool status -x zfs-pool pool: zfs-pool state: DEGRADED status: One or more devices could not be opened. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Attach the missing device and online it using 'zpool online'. see: http://www.sun.com/msg/ZFS-8000-D3 scrub: none requested config: !!!!!!!!!!!!!!System in panic and freezed!!!!!!!!!!!!!!!!! _______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
-- Regards, Jeremy _______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
