Hi Richard,
Thanks for getting back to me.
On Dec 3, 2011, at 9:03 PM, Richard Elling wrote:
> On Dec 1, 2011, at 5:08 PM, Ryan Wehler wrote:
>
>> During the diagnostics of my SAN failure last week we thought we had seen a
>> backplane failure due to high error counts with 'lsiutil'. However, even
>> with a new backplane and ruling out failed cards (MPXIO or singular) or bad
>> cables I'm still seeing my error count with LSIUTIL increment. I've got no
>> disks attached to the array right now so I've also ruled those out.
>
> The link error counters are on the receiving side. To see the complete
> picture, you need to look at
> link errors on both ends of each link (more below…)
>
>>
>> Even with nothing connected but the HBA to the backplane expander, a simple
>> restart of the SAN into a OpenIndiana LiveCD or other distribution
>> (NexentaStor) increments the counter.
>
> A few counters can tick up when the system is reset at boot. These can be
> ignored.
>
> What you are looking for is a consistent increase of the counters under
> load. In some cases
> I have seen millions of errors per minute on a very unhappy system.
But we're talking about 600,000 -> 2,000,000 errors on a simple reset at boot.
Per my VAR their 6GB hardware show significantly less (in the 10s to 100s of
errors, not 100s to millions).
>
>> I've been as careful as I can be to clear the counter between changes to
>> parts to try and eliminate a potentially bad cable/card/etc. You can see
>> phy 8-15 throw errors irregardless of MPXIO or single card config, OR which
>> expander port I use on the backplane.
>
> The info you attaced doesn't show the topology (lsiutil command 16), so it is
> difficult to say
> why this occurs.
Attached is the output of option 16 on each card.
{\rtf1\ansi\ansicpg1252\cocoartf1038\cocoasubrtf360
{\fonttbl\f0\fswiss\fcharset0 Helvetica;}
{\colortbl;\red255\green255\blue255;}
\margl1440\margr1440\vieww9000\viewh8400\viewkind0
\deftab720
\pard\pardeftab720\ql\qnatural
\f0\fs24 \cf0 Card #1\
\
SAS1068E's links are 3.0 G, 3.0 G, 3.0 G, 3.0 G, down, down, down, down\
\
\'a0B___T \'a0 \'a0 SASAddress \'a0 \'a0 PhyNum \'a0Handle \'a0Parent \'a0Type\
\'a0 \'a0 \'a0 \'a0 500605b0014cb930 \'a0 \'a0 \'a0 \'a0 \'a0 0001 \'a0 \'a0 \'a0 \'a0 \'a0 SAS Initiator\
\'a0 \'a0 \'a0 \'a0 500605b0014cb931 \'a0 \'a0 \'a0 \'a0 \'a0 0002 \'a0 \'a0 \'a0 \'a0 \'a0 SAS Initiator\
\'a0 \'a0 \'a0 \'a0 500605b0014cb932 \'a0 \'a0 \'a0 \'a0 \'a0 0003 \'a0 \'a0 \'a0 \'a0 \'a0 SAS Initiator\
\'a0 \'a0 \'a0 \'a0 500605b0014cb933 \'a0 \'a0 \'a0 \'a0 \'a0 0004 \'a0 \'a0 \'a0 \'a0 \'a0 SAS Initiator\
\'a0 \'a0 \'a0 \'a0 500605b0014cb934 \'a0 \'a0 \'a0 \'a0 \'a0 0005 \'a0 \'a0 \'a0 \'a0 \'a0 SAS Initiator\
\'a0 \'a0 \'a0 \'a0 500605b0014cb935 \'a0 \'a0 \'a0 \'a0 \'a0 0006 \'a0 \'a0 \'a0 \'a0 \'a0 SAS Initiator\
\'a0 \'a0 \'a0 \'a0 500605b0014cb936 \'a0 \'a0 \'a0 \'a0 \'a0 0007 \'a0 \'a0 \'a0 \'a0 \'a0 SAS Initiator\
\'a0 \'a0 \'a0 \'a0 500605b0014cb937 \'a0 \'a0 \'a0 \'a0 \'a0 0008 \'a0 \'a0 \'a0 \'a0 \'a0 SAS Initiator\
\'a0 \'a0 \'a0 \'a0 500304800111abff \'a0 \'a0 0 \'a0 \'a0 0009 \'a0 \'a00001 \'a0 Edge Expander\
\'a00 \'a0 0 \'a05000c500040e92f5 \'a0 \'a0 0 \'a0 \'a0 000a \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a0 1 \'a05000c500040eb1f1 \'a0 \'a0 1 \'a0 \'a0 000b \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a0 2 \'a05000c50017a58869 \'a0 \'a0 2 \'a0 \'a0 000c \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a0 3 \'a05000c50017418d4d \'a0 \'a0 3 \'a0 \'a0 000d \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a0 4 \'a05000c50017a58b51 \'a0 \'a0 4 \'a0 \'a0 000e \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a0 5 \'a05000c50017a5892d \'a0 \'a0 5 \'a0 \'a0 000f \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a0 6 \'a05000c50017a66061 \'a0 \'a0 6 \'a0 \'a0 0010 \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a0 7 \'a05000c50017a677f5 \'a0 \'a0 7 \'a0 \'a0 0011 \'a0 \'a00009 \'a0 SAS Target\
\'a0 \'a0 \'a0 \'a0 500605b0014ca930 \'a0 \'a012 \'a0 \'a0 0012 \'a0 \'a00009 \'a0 SAS Initiator, not present\
\'a00 \'a0 8 \'a05000c5003bf025b5 \'a0 \'a022 \'a0 \'a0 0013 \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a0 9 \'a05000c5003be44d55 \'a0 \'a023 \'a0 \'a0 0014 \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a010 \'a05000c50017a6a635 \'a0 \'a024 \'a0 \'a0 0015 \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a011 \'a05000c500174132f9 \'a0 \'a025 \'a0 \'a0 0016 \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a012 \'a05000c50017a64da1 \'a0 \'a026 \'a0 \'a0 0017 \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a013 \'a05000c50017a58729 \'a0 \'a027 \'a0 \'a0 0018 \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a014 \'a05000c5001741b321 \'a0 \'a028 \'a0 \'a0 0019 \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a015 \'a05000c500174190a5 \'a0 \'a029 \'a0 \'a0 001a \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a016 \'a05000c50017a58b11 \'a0 \'a030 \'a0 \'a0 001b \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a017 \'a05000c50017a69511 \'a0 \'a031 \'a0 \'a0 001c \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a018 \'a05000c5003bf22ebd \'a0 \'a032 \'a0 \'a0 001d \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a019 \'a05000c5003bd9c6b5 \'a0 \'a033 \'a0 \'a0 001e \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a020 \'a05000c5003bd96555 \'a0 \'a034 \'a0 \'a0 001f \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a021 \'a05000c5003bd95db5 \'a0 \'a035 \'a0 \'a0 0020 \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a022 \'a0500304800111abfd \'a0 \'a036 \'a0 \'a0 0021 \'a0 \'a00009 \'a0 SAS Initiator and Target\
\
Type \'a0 \'a0 \'a0NumPhys \'a0 \'a0PhyNum \'a0Handle \'a0 \'a0 PhyNum \'a0Handle \'a0Port \'a0Speed\
Adapter \'a0 \'a0 \'a08 \'a0 \'a0 \'a0 \'a0 \'a00 \'a0 \'a0 0001 \'a0--> \'a0 11 \'a0 \'a0 0009 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 1 \'a0 \'a0 0001 \'a0--> \'a0 10 \'a0 \'a0 0009 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 2 \'a0 \'a0 0001 \'a0--> \'a0 \'a09 \'a0 \'a0 0009 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 3 \'a0 \'a0 0001 \'a0--> \'a0 \'a08 \'a0 \'a0 0009 \'a0 \'a0 0 \'a0 \'a03.0\
\
Expander \'a0 \'a038 \'a0 \'a0 \'a0 \'a0 \'a00 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 000a \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 1 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 000b \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 2 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 000c \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 3 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 000d \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 4 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 000e \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 5 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 000f \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 6 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0010 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 7 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0011 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 8 \'a0 \'a0 0009 \'a0--> \'a0 \'a03 \'a0 \'a0 0001 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 9 \'a0 \'a0 0009 \'a0--> \'a0 \'a02 \'a0 \'a0 0001 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a010 \'a0 \'a0 0009 \'a0--> \'a0 \'a01 \'a0 \'a0 0001 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a011 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0001 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a012 \'a0 \'a0 0009 \'a0--> \'a0 \'a03 \'a0 \'a0 0012 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a013 \'a0 \'a0 0009 \'a0--> \'a0 \'a02 \'a0 \'a0 0012 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a014 \'a0 \'a0 0009 \'a0--> \'a0 \'a01 \'a0 \'a0 0012 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a015 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0012 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a022 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0013 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a023 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0014 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a024 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0015 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a025 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0016 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a026 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0017 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a027 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0018 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a028 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0019 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a029 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 001a \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a030 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 001b \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a031 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 001c \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a032 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 001d \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a033 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 001e \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a034 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 001f \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a035 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0020 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a036 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0021 \'a0 \'a0 0 \'a0 \'a03.0\
\
Enclosure Handle \'a0 Slots \'a0 \'a0 \'a0 SASAddress \'a0 \'a0 \'a0 B___T (SEP)\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a00001 \'a0 \'a0 \'a08 \'a0 \'a0 \'a0500605b0014cb930\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a00002 \'a0 \'a0 25 \'a0 \'a0 \'a0500304800111abff \'a0 \'a00 \'a022\
\
\
Card #2\
\
SAS1068E's links are 3.0 G, 3.0 G, 3.0 G, 3.0 G, down, down, down, down\
\
\'a0B___T \'a0 \'a0 SASAddress \'a0 \'a0 PhyNum \'a0Handle \'a0Parent \'a0Type\
\'a0 \'a0 \'a0 \'a0 500605b0014ca930 \'a0 \'a0 \'a0 \'a0 \'a0 0001 \'a0 \'a0 \'a0 \'a0 \'a0 SAS Initiator\
\'a0 \'a0 \'a0 \'a0 500605b0014ca931 \'a0 \'a0 \'a0 \'a0 \'a0 0002 \'a0 \'a0 \'a0 \'a0 \'a0 SAS Initiator\
\'a0 \'a0 \'a0 \'a0 500605b0014ca932 \'a0 \'a0 \'a0 \'a0 \'a0 0003 \'a0 \'a0 \'a0 \'a0 \'a0 SAS Initiator\
\'a0 \'a0 \'a0 \'a0 500605b0014ca933 \'a0 \'a0 \'a0 \'a0 \'a0 0004 \'a0 \'a0 \'a0 \'a0 \'a0 SAS Initiator\
\'a0 \'a0 \'a0 \'a0 500605b0014ca934 \'a0 \'a0 \'a0 \'a0 \'a0 0005 \'a0 \'a0 \'a0 \'a0 \'a0 SAS Initiator\
\'a0 \'a0 \'a0 \'a0 500605b0014ca935 \'a0 \'a0 \'a0 \'a0 \'a0 0006 \'a0 \'a0 \'a0 \'a0 \'a0 SAS Initiator\
\'a0 \'a0 \'a0 \'a0 500605b0014ca936 \'a0 \'a0 \'a0 \'a0 \'a0 0007 \'a0 \'a0 \'a0 \'a0 \'a0 SAS Initiator\
\'a0 \'a0 \'a0 \'a0 500605b0014ca937 \'a0 \'a0 \'a0 \'a0 \'a0 0008 \'a0 \'a0 \'a0 \'a0 \'a0 SAS Initiator\
\'a0 \'a0 \'a0 \'a0 500304800111abff \'a0 \'a0 0 \'a0 \'a0 0009 \'a0 \'a00001 \'a0 Edge Expander\
\'a00 \'a0 0 \'a05000c500040e92f5 \'a0 \'a0 0 \'a0 \'a0 000a \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a0 1 \'a05000c500040eb1f1 \'a0 \'a0 1 \'a0 \'a0 000b \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a0 2 \'a05000c50017a58869 \'a0 \'a0 2 \'a0 \'a0 000c \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a0 3 \'a05000c50017418d4d \'a0 \'a0 3 \'a0 \'a0 000d \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a0 4 \'a05000c50017a58b51 \'a0 \'a0 4 \'a0 \'a0 000e \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a0 5 \'a05000c50017a5892d \'a0 \'a0 5 \'a0 \'a0 000f \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a0 6 \'a05000c50017a66061 \'a0 \'a0 6 \'a0 \'a0 0010 \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a0 7 \'a05000c50017a677f5 \'a0 \'a0 7 \'a0 \'a0 0011 \'a0 \'a00009 \'a0 SAS Target\
\'a0 \'a0 \'a0 \'a0 500605b0014cb930 \'a0 \'a0 8 \'a0 \'a0 0012 \'a0 \'a00009 \'a0 SAS Initiator, not present\
\'a00 \'a0 8 \'a05000c5003bf025b5 \'a0 \'a022 \'a0 \'a0 0013 \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a0 9 \'a05000c5003be44d55 \'a0 \'a023 \'a0 \'a0 0014 \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a010 \'a05000c50017a6a635 \'a0 \'a024 \'a0 \'a0 0015 \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a011 \'a05000c500174132f9 \'a0 \'a025 \'a0 \'a0 0016 \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a012 \'a05000c50017a64da1 \'a0 \'a026 \'a0 \'a0 0017 \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a013 \'a05000c50017a58729 \'a0 \'a027 \'a0 \'a0 0018 \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a014 \'a05000c5001741b321 \'a0 \'a028 \'a0 \'a0 0019 \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a015 \'a05000c500174190a5 \'a0 \'a029 \'a0 \'a0 001a \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a016 \'a05000c50017a58b11 \'a0 \'a030 \'a0 \'a0 001b \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a017 \'a05000c50017a69511 \'a0 \'a031 \'a0 \'a0 001c \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a018 \'a05000c5003bf22ebd \'a0 \'a032 \'a0 \'a0 001d \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a019 \'a05000c5003bd9c6b5 \'a0 \'a033 \'a0 \'a0 001e \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a020 \'a05000c5003bd96555 \'a0 \'a034 \'a0 \'a0 001f \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a021 \'a05000c5003bd95db5 \'a0 \'a035 \'a0 \'a0 0020 \'a0 \'a00009 \'a0 SAS Target\
\'a00 \'a022 \'a0500304800111abfd \'a0 \'a036 \'a0 \'a0 0021 \'a0 \'a00009 \'a0 SAS Initiator and Target\
\
Type \'a0 \'a0 \'a0NumPhys \'a0 \'a0PhyNum \'a0Handle \'a0 \'a0 PhyNum \'a0Handle \'a0Port \'a0Speed\
Adapter \'a0 \'a0 \'a08 \'a0 \'a0 \'a0 \'a0 \'a00 \'a0 \'a0 0001 \'a0--> \'a0 15 \'a0 \'a0 0009 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 1 \'a0 \'a0 0001 \'a0--> \'a0 14 \'a0 \'a0 0009 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 2 \'a0 \'a0 0001 \'a0--> \'a0 13 \'a0 \'a0 0009 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 3 \'a0 \'a0 0001 \'a0--> \'a0 12 \'a0 \'a0 0009 \'a0 \'a0 0 \'a0 \'a03.0\
\
Expander \'a0 \'a038 \'a0 \'a0 \'a0 \'a0 \'a00 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 000a \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 1 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 000b \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 2 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 000c \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 3 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 000d \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 4 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 000e \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 5 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 000f \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 6 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0010 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 7 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0011 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 8 \'a0 \'a0 0009 \'a0--> \'a0 \'a03 \'a0 \'a0 0012 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 9 \'a0 \'a0 0009 \'a0--> \'a0 \'a02 \'a0 \'a0 0012 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a010 \'a0 \'a0 0009 \'a0--> \'a0 \'a01 \'a0 \'a0 0012 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a011 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0012 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a012 \'a0 \'a0 0009 \'a0--> \'a0 \'a03 \'a0 \'a0 0001 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a013 \'a0 \'a0 0009 \'a0--> \'a0 \'a02 \'a0 \'a0 0001 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a014 \'a0 \'a0 0009 \'a0--> \'a0 \'a01 \'a0 \'a0 0001 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a015 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0001 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a022 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0013 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a023 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0014 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a024 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0015 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a025 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0016 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a026 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0017 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a027 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0018 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a028 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0019 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a029 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 001a \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a030 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 001b \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a031 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 001c \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a032 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 001d \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a033 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 001e \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a034 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 001f \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a035 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0020 \'a0 \'a0 0 \'a0 \'a03.0\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a0 \'a036 \'a0 \'a0 0009 \'a0--> \'a0 \'a00 \'a0 \'a0 0021 \'a0 \'a0 0 \'a0 \'a03.0\
\
Enclosure Handle \'a0 Slots \'a0 \'a0 \'a0 SASAddress \'a0 \'a0 \'a0 B___T (SEP)\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a00001 \'a0 \'a0 \'a08 \'a0 \'a0 \'a0500605b0014ca930\
\'a0 \'a0 \'a0 \'a0 \'a0 \'a00002 \'a0 \'a0 25 \'a0 \'a0 \'a0500304800111abff \'a0 \'a00 \'a022}
>
>>
>> According to my VAR something in the mptsas code changed "recently" (not
>> sure what that means in time terms) and they do not see the problems with
>> 6GB backplanes and adapters.
>
> These counters are in the physical interfaces, far away from any OS.
>
>>
>> <SAS Diags.txt>
>>
>>
>> Attached is a log I took through NexentaStor 3.1.1 with my disks still
>> attached. The disks themselves don't seem to be throwing errors, so that's
>> good.
>
> To see errors from the disk's perspective, you need to look at the disk's
> logs.
> I use sg3 utils for this (sg_logs -a /dev/rdsk/...)
>
I'd paste some of this, but the output would be pretty big. :) I'll look more
into this. Though my "errors corrected without substantial delay" stands out as
pretty high, even on a new disk I just received. Is there anything specific I
should be looking at?
>>
>>
>> Has anyone seen anything like this? I have not tried to boot into an older
>> version of Solaris or NexentaStor yet, but booting into Scientific Linux 6.1
>> yields about the same results with lsiutil.
>
> Yes. Root cause is always hardware.
>
>>
>> Nothing from fmadm, /var/adm/messages or otherwise indicate these data
>> errors outside of lsiutil.
>
> Those errors are counters as part of the SAS link state machine. The symptoms
> will show as
> poor performance or occasional command resets at the OS level.
> -- richard
>
> --
>
> ZFS and performance consulting
> http://www.RichardElling.com
> LISA '11, Boston, MA, December 4-9
>
>
>
>
>
>
>
>
>
>
>
>
>
>
_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
