Re: [zfs-discuss] weird thing with zfs

[Krzys]

Thanks so much.. anyway resilvering worked its way, I got everything resolved
zpool status -v
  pool: mypool
 state: ONLINE
 scrub: none requested
config:
        NAME        STATE     READ WRITE CKSUM
        mypool      ONLINE       0     0     0
          mirror    ONLINE       0     0     0
            c1t2d0  ONLINE       0     0     0
            c1t3d0  ONLINE       0     0     0

errors: No known data errors

  pool: mypool2
 state: ONLINE
 scrub: resilver completed with 0 errors on Tue Dec  5 13:48:31 2006
config:

        NAME        STATE     READ WRITE CKSUM
        mypool2     ONLINE       0     0     0
          raidz     ONLINE       0     0     0
            c3t0d0  ONLINE       0     0     0
            c3t1d0  ONLINE       0     0     0
            c3t2d0  ONLINE       0     0     0
            c3t3d0  ONLINE       0     0     0
            c3t4d0  ONLINE       0     0     0
            c3t5d0  ONLINE       0     0     0
            c3t6d0  ONLINE       0     0     0

errors: No known data errors

did not change any cables nor anything, just reboot... I will llook into 
replacing cables (those are the short scsi cables.. anyway this is so weird and 
original disk that I replaced seems to be good as well.. it must be connectivity 
problem... but whats weird is that I had it running for months without 
problems...

Regards and thanks to all for help.

Chris



On Tue, 5 Dec 2006, Richard Elling wrote:

BTW, there is a way to check what the SCSI negotiations resolved to.
I wrote about it once in a BluePrint
        http://www.sun.com/blueprints/0500/sysperfnc.pdf
See page 11
-- richard

Richard Elling wrote:
This looks more like a cabling or connector problem.  When that happens
you should see parity errors and transfer rate negotiations.
 -- richard

Krzys wrote:
Ok, so here is an update

I did restart my sysyte, I power it off and power it on. Here is screen 
capture of my boot. I certainly do have some hard drive issues and will 
need to take a look at them... But I got my disk back visible to the 
system and zfs is doing resilvering again

Rebooting with command: boot
Boot device: /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0:a  
File and args:
SunOS Release 5.10 Version Generic_118833-24 64-bit
Copyright 1983-2006 Sun Microsystems, Inc.  All rights reserved.
Use is subject to license terms.
Hardware watchdog enabled
Hostname: chrysek
WARNING: /[EMAIL PROTECTED],600000/[EMAIL PROTECTED] (glm2):
        SCSI bus DATA IN phase parity error
WARNING: /[EMAIL PROTECTED],600000/[EMAIL PROTECTED] (glm2):
        Target 6 reducing sync. transfer rate
WARNING: /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0 (sd5):
        Error for Command: read(10)                Error Level: Retryable
        Requested Block: 286732066                 Error Block: 286732066
        Vendor: SEAGATE                            Serial Number: 3HY14PVS
        Sense Key: Aborted Command
        ASC: 0x48 (initiator detected error message received), ASCQ: 0x0, 
FRU: 0x2
WARNING: /[EMAIL PROTECTED],600000/[EMAIL PROTECTED] (glm2):
        SCSI bus DATA IN phase parity error
WARNING: /[EMAIL PROTECTED],600000/[EMAIL PROTECTED] (glm2):
        Target 3 reducing sync. transfer rate
WARNING: /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0 (sd23):
        Error for Command: read(10)                Error Level: Retryable
        Requested Block: 283623842                 Error Block: 283623842
        Vendor: SEAGATE                            Serial Number: 3HY8HS7L
        Sense Key: Aborted Command
        ASC: 0x48 (initiator detected error message received), ASCQ: 0x0, 
FRU: 0x2
WARNING: /[EMAIL PROTECTED],600000/[EMAIL PROTECTED] (glm2):
        SCSI bus DATA IN phase parity error
WARNING: /[EMAIL PROTECTED],600000/[EMAIL PROTECTED] (glm2):
        Target 5 reducing sync. transfer rate
WARNING: /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0 (sd25):
        Error for Command: read(10)                Error Level: Retryable
        Requested Block: 283623458                 Error Block: 283623458
        Vendor: SEAGATE                            Serial Number: 3HY0LF18
        Sense Key: Aborted Command
        ASC: 0x48 (initiator detected error message received), ASCQ: 0x0, 
FRU: 0x2
/kernel/drv/sparcv9/zpool symbol avl_add multiply defined
/kernel/drv/sparcv9/zpool symbol assfail3 multiply defined
WARNING: kstat_create('unix', 0, 'dmu_buf_impl_t'): namespace collision
mypool2/d3 uncorrectable error
checking ufs filesystems
/dev/rdsk/c1t0d0s7: is logging.

chrysek console login: VERITAS SCSA Generic Revision: 3.5c
Dec  5 13:01:38 chrysek root: CAPTURE_UPTIME ERROR: /var/opt/SUNWsrsrp 
missing
Dec  5 13:01:38 chrysek root: CAPTURE_UPTIME ERROR: /var/opt/SUNWsrsrp 
missing
Dec  5 13:01:46 chrysek VERITAS: No proxy found.
Dec  5 13:01:52 chrysek vmd[546]: ready for connections
Dec  5 13:01:53 chrysek VERITAS: No proxy found.
Dec  5 13:01:54 chrysek VERITAS: No proxy found.
Dec  5 13:02:00 chrysek VERITAS: No proxy found.
Dec  5 13:02:01 chrysek VERITAS: No proxy found.
Dec  5 13:02:03 chrysek VERITAS: No proxy found.
starting NetWorker daemons:
 nsrexecd
 lgtolmd
Dec  5 13:02:20 chrysek CNS Transport[841]: cctransport started
Dec  5 13:02:48 chrysek webmin[1353]: Webmin starting
Dec  5 13:19:07 chrysek scsi: WARNING: /[EMAIL PROTECTED],600000/[EMAIL 
PROTECTED] (glm2):
Dec  5 13:19:07 chrysek         Target 6 disabled wide SCSI mode
Dec  5 13:19:07 chrysek scsi: WARNING: /[EMAIL PROTECTED],600000/[EMAIL 
PROTECTED] (glm2):
Dec  5 13:19:07 chrysek         Target 6 reverting to async. mode
Dec  5 13:19:07 chrysek scsi: WARNING: /[EMAIL PROTECTED],600000/[EMAIL 
PROTECTED]/[EMAIL PROTECTED],0 (sd5):
Dec  5 13:19:07 chrysek         Error for Command: write(10) 
Error Level: Retryable
Dec  5 13:19:07 chrysek scsi:   Requested Block: 137163259 
Error Block: 137163259
Dec  5 13:19:07 chrysek scsi:   Vendor: SEAGATE Serial Number: 3HY14PVS
Dec  5 13:19:07 chrysek scsi:   Sense Key: Aborted Command
Dec  5 13:19:07 chrysek scsi:   ASC: 0x47 (scsi parity error), ASCQ: 0x0, 
FRU: 0x3


but now when I do zpool status -v
  pool: mypool
 state: ONLINE
 scrub: none requested
config:

        NAME        STATE     READ WRITE CKSUM
        mypool      ONLINE       0     0     0
          mirror    ONLINE       0     0     0
            c1t2d0  ONLINE       0     0     0
            c1t3d0  ONLINE       0     0     0

errors: No known data errors

  pool: mypool2
 state: DEGRADED
status: One or more devices is currently being resilvered.  The pool will
        continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
 scrub: resilver in progress, 4.40% done, 11h40m to go
config:

        NAME              STATE     READ WRITE CKSUM
        mypool2           DEGRADED     0     0     0
          raidz           DEGRADED     0     0     0
            c3t0d0        ONLINE       0     0     0
            c3t1d0        ONLINE       0     0     0
            c3t2d0        ONLINE       0     0     0
            c3t3d0        ONLINE       0     0     0
            c3t4d0        ONLINE       0     0     0
            c3t5d0        ONLINE       0     0     0
            replacing     DEGRADED     0     0    12
              c3t6d0s0/o  UNAVAIL      0     0     0  cannot open
              c3t6d0      ONLINE       0     0     0

errors: No known data errors

I do see that drive... and it is doing resilvering

format works too and I dont get coredump

format
Searching for disks...done


AVAILABLE DISK SELECTIONS:
       0. c1t0d0 <SEAGATE-ST3300007LC-D703 cyl 45265 alt 2 hd 16 sec 809>
          /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0
       1. c1t1d0 <SEAGATE-ST3300007LC-D703 cyl 45265 alt 2 hd 16 sec 809>
          /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0
       2. c1t2d0 <SEAGATE-ST3300007LC-D703-279.40GB>
          /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0
       3. c1t3d0 <SEAGATE-ST3300007LC-D703-279.40GB>
          /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0
       4. c3t0d0 <SEAGATE-ST3146807LC-0007-136.73GB>
          /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0
       5. c3t1d0 <SEAGATE-ST3146807LC-0007-136.73GB>
          /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0
       6. c3t2d0 <SEAGATE-ST3146807LC-0007-136.73GB>
          /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0
       7. c3t3d0 <SEAGATE-ST3146807LC-0007-136.73GB>
          /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0
       8. c3t4d0 <SEAGATE-ST3146807LC-0007-136.73GB>
          /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0
       9. c3t5d0 <SEAGATE-ST3146807LC-0007-136.73GB>
          /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0
      10. c3t6d0 <SEAGATE-ST3146807LC-0007-136.73GB>
          /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0
Specify disk (enter its number): 10
selecting c3t6d0
[disk formatted]
/dev/dsk/c3t6d0s0 is part of active ZFS pool mypool2. Please see 
zpool(1M).


FORMAT MENU:
        disk       - select a disk
        type       - select (define) a disk type
        partition  - select (define) a partition table
        current    - describe the current disk
        format     - format and analyze the disk
        repair     - repair a defective sector
        label      - write label to the disk
        analyze    - surface analysis
        defect     - defect list management
        backup     - search for backup labels
        verify     - read and display labels
        inquiry    - show vendor, product and revision
        volname    - set 8-character volume name
        !<cmd>     - execute <cmd>, then return
        quit
format> verify

Volume name = <        >
ascii name  = <SEAGATE-ST3146807LC-0007-136.73GB>
bytes/sector    =  512
sectors = 286749487
accessible sectors = 286749454
Part      Tag    Flag     First Sector         Size         Last Sector
  0        usr    wm                34      136.72GB          286733070
  1 unassigned    wm                 0           0               0
  2 unassigned    wm                 0           0               0
  3 unassigned    wm                 0           0               0
  4 unassigned    wm                 0           0               0
  5 unassigned    wm                 0           0               0
  6 unassigned    wm                 0           0               0
  8   reserved    wm         286733071        8.00MB          286749454

format> q







On Tue, 5 Dec 2006, Krzys wrote:


ok, two weeks ago I did notice one of my disk in zpool got problems.
I was getting "Corrupt label; wrong magic number" messages, then when I 
looked in format it did not see that disk... (last disk) I had that setup 
running for few months now and all of the sudden last disk failed. So I 
ordered another disk, had it replaced like a week ago, I did issue 
replace command after disk replacement, it was resilvering disks since 
forever, then I got hints from this group that snaps could be causing it 
so yesterday I did disable snaps and this morning I di dnotice the same 
disk that I replaced is gone... Does it seem weird that this disk would 
fail? Its new disk... I have Solaris 10 U2, 4 internal drives and then 7 
external drives which are in single enclousures connected via scsi chain 
to each other... So it seems like last disk is failing. Those nipacks 
from sun have self termination so there is no terminator at the end... 
Any ideas what should I do? Do I need to order another drive and replace 
that one too? Or will it happen again? What do you think could be the 
problem? Ah, when I look at that enclosure I do see green light on it so 
it seems like it did not fail...

format
Searching for disks...
efi_alloc_and_init failed.
done


AVAILABLE DISK SELECTIONS:
      0. c1t0d0 <SEAGATE-ST3300007LC-D703 cyl 45265 alt 2 hd 16 sec 809>
         /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0
      1. c1t1d0 <SEAGATE-ST3300007LC-D703 cyl 45265 alt 2 hd 16 sec 809>
         /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0
      2. c1t2d0 <SEAGATE-ST3300007LC-D703-279.40GB>
         /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0
      3. c1t3d0 <SEAGATE-ST3300007LC-D703-279.40GB>
         /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0
      4. c3t0d0 <SEAGATE-ST3146807LC-0007-136.73GB>
         /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0
      5. c3t1d0 <SEAGATE-ST3146807LC-0007-136.73GB>
         /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0
      6. c3t2d0 <SEAGATE-ST3146807LC-0007-136.73GB>
         /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0
      7. c3t3d0 <SEAGATE-ST3146807LC-0007-136.73GB>
         /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0
      8. c3t4d0 <SEAGATE-ST3146807LC-0007-136.73GB>
         /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0
      9. c3t5d0 <SEAGATE-ST3146807LC-0007-136.73GB>
         /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0
     10. c3t6d0 <drive type unknown>
         /[EMAIL PROTECTED],600000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0



zpool status -v
 pool: mypool
state: ONLINE
scrub: none requested
config:

       NAME        STATE     READ WRITE CKSUM
       mypool      ONLINE       0     0     0
         mirror    ONLINE       0     0     0
           c1t2d0  ONLINE       0     0     0
           c1t3d0  ONLINE       0     0     0

errors: No known data errors

 pool: mypool2
state: DEGRADED
scrub: resilver completed with 0 errors on Mon Dec  4 22:34:57 2006
config:

       NAME              STATE     READ WRITE CKSUM
       mypool2           DEGRADED     0     0     0
         raidz           DEGRADED     0     0     0
           c3t0d0        ONLINE       0     0     0
           c3t1d0        ONLINE       0     0     0
           c3t2d0        ONLINE       0     0     0
           c3t3d0        ONLINE       0     0     0
           c3t4d0        ONLINE       0     0     0
           c3t5d0        ONLINE       0     0     0
           replacing     UNAVAIL      0   775     0  insufficient 
replicas
             c3t6d0s0/o  UNAVAIL      0     0     0  cannot open
             c3t6d0      UNAVAIL      0   940     0  cannot open

errors: No known data errors

_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss




_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss


!DSPAM:122,4575c6a814723197925582!

_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss