On Fri, Nov 08, 2019 at 04:31:54PM +0100, Mohamed LAROUCI wrote:
> Hi Folks,
>
> I'd like to share our experience/troubles 🙂 that we are experiencing with 4
> PowerEdge R230 for few months.
>
> Our servers are running Openbsd 6.5 OS and we have had several system
> freezes (where only a hard reboot fixed the problem).
>
> We identified the source of theses freezes, so that every time the servers
> hanged, we find the error below in the Raid H330 logs.
>
> "Assertion failure in ../../raid/mpthostcmd.c at line 656:MonTask: line 656
> in file ../../raid/mpthostcmd.c Invader: sp=c00ae118 online reset - no input
> needed_esram_initial_code:c02264d0 _io_path_code_start:c0233880
> _io_path_code_end:c025fdd4
To be clear, this is an error message from the card's firmware, not
from OpenBSD.
-Otto
>
> C0:online reset - wait for Reset to occur
>
> montask 1
>
> _MonTask: Online Controller Reset"
>
> Has anyone run into the same problem ?
>
> I'm wondering, if a replace both disk and raid controllers by new ones.
>
> Thank you for your feedbacks.
>
> Server: PE R230
>
> Raid Controller: H330
>
> Disk: Toshiba DT01ACA0 - 500G SATA
>
> You can find a dmeg output below.
>
> Best regards,
> Mohamed Larouci.
>
> ~# dmesg
> OpenBSD 6.5 (GENERIC.MP) #1: Mon May 27 18:27:59 CEST 2019
>
> r...@syspatch-65-amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
> real mem = 4100808704 (3910MB)
> avail mem = 3966902272 (3783MB)
> mpath0 at root
> scsibus0 at mpath0: 256 targets
> mainbus0 at root
> bios0 at mainbus0: SMBIOS rev. 2.8 @ 0x8ef68000 (43 entries)
> bios0: vendor Dell Inc. version "2.6.1" date 12/06/2018
> bios0: Dell Inc. PowerEdge R230
> acpi0 at bios0: rev 2
> acpi0: sleep states S0 S5
> acpi0: tables DSDT FACP SSDT TPM2 BOOT SSDT SLIC HPET LPIT APIC MCFG
> WDAT SSDT DBGP DBG2 SSDT SSDT SSDT SSDT SSDT SSDT PRAD HEST BERT ERST
> EINJ DMAR FPDT
> acpi0: wakeup devices PEGP(S0) PEG0(S0) PEGP(S0) PEG1(S0) PEGP(S0)
> PEG2(S0) XHC_(S0) XDCI(S0) PXSX(S0) RP01(S0) PXSX(S0) RP02(S0)
> PXSX(S0) RP03(S0) PXSX(S0) RP04(S0) [...]
> acpitimer0 at acpi0: 3579545 Hz, 24 bits
> acpihpet0 at acpi0: 23999999 Hz
> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
> cpu0 at mainbus0: apid 0 (boot processor)
> cpu0: Intel(R) Xeon(R) CPU E3-1230 v6 @ 3.50GHz, 3692.78 MHz, 06-9e-09
> cpu0:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> cpu0: 256KB 64b/line 8-way L2 cache
> cpu0: smt 0, core 0, package 0
> mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
> cpu0: apic clock running at 23MHz
> cpu0: mwait min=64, max=64, C-substates=0.2.1.2.4.1, IBE
> cpu1 at mainbus0: apid 2 (application processor)
> cpu1: Intel(R) Xeon(R) CPU E3-1230 v6 @ 3.50GHz, 3691.36 MHz, 06-9e-09
> cpu1:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> cpu1: 256KB 64b/line 8-way L2 cache
> cpu1: smt 0, core 1, package 0
> cpu2 at mainbus0: apid 4 (application processor)
> cpu2: Intel(R) Xeon(R) CPU E3-1230 v6 @ 3.50GHz, 3691.36 MHz, 06-9e-09
> cpu2:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> cpu2: 256KB 64b/line 8-way L2 cache
> cpu2: smt 0, core 2, package 0
> cpu3 at mainbus0: apid 6 (application processor)
> cpu3: Intel(R) Xeon(R) CPU E3-1230 v6 @ 3.50GHz, 3691.36 MHz, 06-9e-09
> cpu3:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> cpu3: 256KB 64b/line 8-way L2 cache
> cpu3: smt 0, core 3, package 0
> cpu4 at mainbus0: apid 1 (application processor)
> cpu4: Intel(R) Xeon(R) CPU E3-1230 v6 @ 3.50GHz, 3691.36 MHz, 06-9e-09
> cpu4:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> cpu4: 256KB 64b/line 8-way L2 cache
> cpu4: smt 1, core 0, package 0
> cpu5 at mainbus0: apid 3 (application processor)
> cpu5: Intel(R) Xeon(R) CPU E3-1230 v6 @ 3.50GHz, 3691.35 MHz, 06-9e-09
> cpu5:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> cpu5: 256KB 64b/line 8-way L2 cache
> cpu5: smt 1, core 1, package 0
> cpu6 at mainbus0: apid 5 (application processor)
> cpu6: Intel(R) Xeon(R) CPU E3-1230 v6 @ 3.50GHz, 3691.36 MHz, 06-9e-09
> cpu6:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> cpu6: 256KB 64b/line 8-way L2 cache
> cpu6: smt 1, core 2, package 0
> cpu7 at mainbus0: apid 7 (application processor)
> cpu7: Intel(R) Xeon(R) CPU E3-1230 v6 @ 3.50GHz, 3691.35 MHz, 06-9e-09
> cpu7:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> cpu7: 256KB 64b/line 8-way L2 cache
> cpu7: smt 1, core 3, package 0
> ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 20, 24 pins
> acpimcfg0 at acpi0
> acpimcfg0: addr 0xe0000000, bus 0-255
> acpiprt0 at acpi0: bus 0 (PCI0)
> acpiprt0: no apic found for irq 32
> acpiprt0: no apic found for irq 33
> acpiprt0: no apic found for irq 34
> acpiprt1 at acpi0: bus 1 (PEG0)
> acpiprt2 at acpi0: bus 2 (PEG1)
> acpiprt3 at acpi0: bus -1 (PEG2)
> acpiprt4 at acpi0: bus -1 (RP01)
> acpiprt5 at acpi0: bus -1 (RP02)
> acpiprt6 at acpi0: bus -1 (RP03)
> acpiprt7 at acpi0: bus -1 (RP04)
> acpiprt8 at acpi0: bus -1 (RP05)
> acpiprt9 at acpi0: bus -1 (RP06)
> acpiprt10 at acpi0: bus -1 (RP07)
> acpiprt11 at acpi0: bus -1 (RP08)
> acpiprt12 at acpi0: bus 3 (RP09)
> acpiprt13 at acpi0: bus -1 (RP10)
> acpiprt14 at acpi0: bus 4 (RP11)
> acpiprt15 at acpi0: bus -1 (RP12)
> acpiprt16 at acpi0: bus -1 (RP13)
> acpiprt17 at acpi0: bus -1 (RP14)
> acpiprt18 at acpi0: bus -1 (RP15)
> acpiprt19 at acpi0: bus -1 (RP16)
> acpiprt20 at acpi0: bus -1 (RP17)
> acpiprt21 at acpi0: bus -1 (RP18)
> acpiprt22 at acpi0: bus -1 (RP19)
> acpiprt23 at acpi0: bus -1 (RP20)
> acpicpu0 at acpi0: C1(@1 halt!)
> acpicpu1 at acpi0: C1(@1 halt!)
> acpicpu2 at acpi0: C1(@1 halt!)
> acpicpu3 at acpi0: C1(@1 halt!)
> acpicpu4 at acpi0: C1(@1 halt!)
> acpicpu5 at acpi0: C1(@1 halt!)
> acpicpu6 at acpi0: C1(@1 halt!)
> acpicpu7 at acpi0: C1(@1 halt!)
> acpipci0 at acpi0 PCI0: 0x00000000 0x00000011 0x00000001
> acpicmos0 at acpi0
> acpibtn0 at acpi0: SLPB
> "PNP0C14" at acpi0 not configured
> "PNP0C33" at acpi0 not configured
> acpivideo0 at acpi0: GFX0
> acpivout0 at acpivideo0: DD1F
> ipmi at mainbus0 not configured
> cpu0: using VERW MDS workaround
> memory map conflict 0xe00fd000/0x1000
> memory map conflict 0xfe000000/0x11000
> pci0 at mainbus0 bus 0
> pchb0 at pci0 dev 0 function 0 "Intel Xeon E3-1200 v6/7 Host" rev 0x05
> ppb0 at pci0 dev 1 function 0 "Intel Core 6G PCIE" rev 0x05: msi
> pci1 at ppb0 bus 1
> mfii0 at pci1 dev 0 function 0 "Symbios Logic MegaRAID SAS3008" rev 0x02: msi
> mfii0: "PERC H330 Adapter", firmware 25.5.5.0005
> scsibus1 at mfii0: 32 targets
> scsibus2 at mfii0: 256 targets
> sd0 at scsibus2 targ 0 lun 0: <ATA, TOSHIBA DT01ACA0, A810> SCSI4
> 0/direct fixed naa.5000039fd2e5488f
> sd0: 476940MB, 512 bytes/sector, 976773168 sectors
> sd1 at scsibus2 targ 1 lun 0: <ATA, TOSHIBA DT01ACA0, A810> SCSI4
> 0/direct fixed naa.5000039fd2e51fc5
> sd1: 476940MB, 512 bytes/sector, 976773168 sectors
> ppb1 at pci0 dev 1 function 1 "Intel Core 6G PCIE" rev 0x05: msi
> pci2 at ppb1 bus 2
> ix0 at pci2 dev 0 function 0 "Intel 82599" rev 0x01: msi, address
> 90:e2:ba:7d:00:94
> ix1 at pci2 dev 0 function 1 "Intel 82599" rev 0x01: msi, address
> 90:e2:ba:7d:00:95
> xhci0 at pci0 dev 20 function 0 "Intel 100 Series xHCI" rev 0x31: msi, xHCI
> 1.0
> usb0 at xhci0: USB revision 3.0
> uhub0 at usb0 configuration 1 interface 0 "Intel xHCI root hub" rev
> 3.00/1.00 addr 1
> pchtemp0 at pci0 dev 20 function 2 "Intel 100 Series Thermal" rev 0x31
> "Intel 100 Series MEI" rev 0x31 at pci0 dev 22 function 0 not configured
> "Intel 100 Series MEI" rev 0x31 at pci0 dev 22 function 1 not configured
> ahci0 at pci0 dev 23 function 0 "Intel 100 Series AHCI" rev 0x31: msi,
> AHCI 1.3.1
> scsibus3 at ahci0: 32 targets
> ppb2 at pci0 dev 29 function 0 "Intel 100 Series PCIE" rev 0xf1: msi
> pci3 at ppb2 bus 3
> 3:0:0: mem address conflict 0xfffc0000/0x40000
> 3:0:1: mem address conflict 0xfffc0000/0x40000
> bge0 at pci3 dev 0 function 0 "Broadcom BCM5720" rev 0x00, BCM5720 A0
> (0x5720000), APE firmware NCSI 1.5.1.0: msi, address 50:9a:4c:7f:93:eb
> brgphy0 at bge0 phy 1: BCM5720C 10/100/1000baseT PHY, rev. 0
> bge1 at pci3 dev 0 function 1 "Broadcom BCM5720" rev 0x00, BCM5720 A0
> (0x5720000), APE firmware NCSI 1.5.1.0: msi, address 50:9a:4c:7f:93:ec
> brgphy1 at bge1 phy 2: BCM5720C 10/100/1000baseT PHY, rev. 0
> ppb3 at pci0 dev 29 function 2 "Intel 100 Series PCIE" rev 0xf1: msi
> pci4 at ppb3 bus 4
> ppb4 at pci4 dev 0 function 0 "Renesas SH7758 PCIE Switch" rev 0x00
> pci5 at ppb4 bus 5
> ppb5 at pci5 dev 0 function 0 "Renesas SH7758 PCIE Switch" rev 0x00
> pci6 at ppb5 bus 6
> ppb6 at pci6 dev 0 function 0 "Renesas SH7758 PCIE-PCI" rev 0x00
> pci7 at ppb6 bus 7
> vga1 at pci7 dev 0 function 0 "Matrox MGA G200eR" rev 0x01
> wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
> wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
> pcib0 at pci0 dev 31 function 0 "Intel C236 LPC" rev 0x31
> "Intel 100 Series PMC" rev 0x31 at pci0 dev 31 function 2 not configured
> ichiic0 at pci0 dev 31 function 4 "Intel 100 Series SMBus" rev 0x31:
> apic 2 int 16
> iic0 at ichiic0
> sdtemp0 at iic0 addr 0x19: stts2004
> isa0 at pcib0
> isadma0 at isa0
> com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
> com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
> pckbc0 at isa0 port 0x60/5 irq 1 irq 12
> pcppi0 at isa0 port 0x61
> spkr0 at pcppi0
> vmm0 at mainbus0: VMX/EPT
> uhub1 at uhub0 port 3 configuration 1 interface 0 "no manufacturer
> Gadget USB HUB" rev 2.00/0.00 addr 2
> uhidev0 at uhub1 port 1 configuration 1 interface 0 "Avocent
> Keyboard/Mouse Function" rev 2.00/0.00 addr 3
> uhidev0: iclass 3/1
> ukbd0 at uhidev0: 8 variable keys, 6 key codes
> wskbd0 at ukbd0: console keyboard, using wsdisplay0
> uhidev1 at uhub1 port 1 configuration 1 interface 1 "Avocent
> Keyboard/Mouse Function" rev 2.00/0.00 addr 3
> uhidev1: iclass 3/1
> ums0 at uhidev1: 3 buttons, Z dir
> wsmouse0 at ums0 mux 0
> uhidev2 at uhub1 port 1 configuration 1 interface 2 "Avocent
> Keyboard/Mouse Function" rev 2.00/0.00 addr 3
> uhidev2: iclass 3/1
> ums1 at uhidev2: 3 buttons, Z dir
> wsmouse1 at ums1 mux 0
> vscsi0 at root
> scsibus4 at vscsi0: 256 targets
> softraid0 at root
> scsibus5 at softraid0: 256 targets
> ukbd0: was console keyboard
> wskbd0 detached
> ukbd0 detached
> uhidev0 detached
> wsmouse0 detached
> ums0 detached
> uhidev1 detached
> wsmouse1 detached
> ums1 detached
> uhidev2 detached
> root on sd0a (88f3411986a4bef8.a) swap on sd0b dump on sd0b
> WARNING: / was not properly unmounted
> uhidev0 at uhub1 port 1 configuration 1 interface 0 "Avocent
> Keyboard/Mouse Function" rev 2.00/0.00 addr 3
> uhidev0: iclass 3/1
> ukbd0 at uhidev0: 8 variable keys, 6 key codes
> wskbd0 at ukbd0: console keyboard, using wsdisplay0
> uhidev1 at uhub1 port 1 configuration 1 interface 1 "Avocent
> Keyboard/Mouse Function" rev 2.00/0.00 addr 3
> uhidev1: iclass 3/1
> ums0 at uhidev1: 3 buttons, Z dir
> wsmouse0 at ums0 mux 0
> uhidev2 at uhub1 port 1 configuration 1 interface 2 "Avocent
> Keyboard/Mouse Function" rev 2.00/0.00 addr 3
> uhidev2: iclass 3/1
> ums1 at uhidev2: 3 buttons, Z dir
> wsmouse1 at ums1 mux 0
> carp0: state transition: BACKUP -> MASTER
> carp1: state transition: BACKUP -> MASTER
> carp10: state transition: BACKUP -> MASTER
> carp11: state transition: BACKUP -> MASTER
> carp12: state transition: BACKUP -> MASTER
> carp13: state transition: BACKUP -> MASTER
> carp14: state transition: BACKUP -> MASTER
> carp15: state transition: BACKUP -> MASTER
> carp16: state transition: BACKUP -> MASTER
> carp19: state transition: BACKUP -> MASTER
> carp21: state transition: BACKUP -> MASTER
> carp22: state transition: BACKUP -> MASTER
> carp23: state transition: BACKUP -> MASTER
> carp24: state transition: BACKUP -> MASTER
> carp27: state transition: BACKUP -> MASTER
> carp7: state transition: BACKUP -> MASTER
> carp28: state transition: BACKUP -> MASTER
> carp29: state transition: BACKUP -> MASTER
> carp30: state transition: BACKUP -> MASTER
> carp31: state transition: BACKUP -> MASTER
> carp34: state transition: BACKUP -> MASTER
> carp36: state transition: BACKUP -> MASTER
> carp38: state transition: BACKUP -> MASTER
> carp39: state transition: BACKUP -> MASTER
> carp40: state transition: BACKUP -> MASTER
> carp41: state transition: BACKUP -> MASTER
> carp42: state transition: BACKUP -> MASTER
> carp5: state transition: BACKUP -> MASTER
> ukbd0: was console keyboard
> wskbd0 detached
> ukbd0 detached
> uhidev0 detached
> wsmouse0 detached
> ums0 detached
> uhidev1 detached
> wsmouse1 detached
> ums1 detached
> uhidev2 detached
>
