Hi all,
in lab I have 2 socket box with lot of interfaces, ix, ixl, mcx, bnxt,
em and bge. When sending high traffic over mcx whole machine is almost
unresponsive, like sending any command over console. In that state
pagedaemon is at 100% sometimes ever higher and mcl12k Fail counter is
rising. In sysctl.conf there is kern.maxclusters=1048576 and
NET_TASKQ=16 in if.c
While sending traffic over ix or ixl in the same machine everything
seems fine. bnxt is fishy and for some other bug report :)
I saw this mcx behavior before mpi@ diff "Add per-CPU caches to the
pmemrange allocator" but didn't manage to trigger panic.
I seems that this mcx behaviour is only under high traffic besause I
have few mcx in producion at they behaves excelent
In the attachment you can find ddb output
Just one question, is it possible to put in ddb something like mach all
ddbcpu or mach ddbcpu all ? :) When having 32 or more cores and
converting decimal to hex cpu number, one can easely make mistake
dmesg
OpenBSD 7.5-current (GENERIC.MP) #2: Sat Jun 1 22:36:05 CEST 2024
hrvoje@bigi.netlab:/sys/arch/amd64/compile/GENERIC.MP
real mem = 410826829824 (391794MB)
avail mem = 398354190336 (379900MB)
random: good seed from bootblocks
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 3.2 @ 0x68e36000 (80 entries)
bios0: vendor Dell Inc. version "2.21.2" date 02/19/2024
bios0: Dell Inc. PowerEdge R740xd
efi0 at bios0: UEFI 2.7
efi0: Dell Inc. rev 0x2150201
acpi0 at bios0: ACPI 6.1
acpi0: sleep states S0 S5
acpi0: tables DSDT FACP SSDT MCEJ WD__ SLIC HPET APIC MCFG MIGT MSCT
PCAT PCCT RASF SLIT SRAT SVOS WSMT OEM4 SSDT SSDT SSDT SPCR DMAR HEST
BERT ERST EINJ
acpi0: wakeup devices XHCI(S4) RP17(S4) PXSX(S4) RP18(S4) PXSX(S4)
RP19(S4) PXSX(S4) RP20(S4) PXSX(S4) RP01(S4) PXSX(S4) RP02(S4) PXSX(S4)
RP03(S4) PXSX(S4) RP04(S4) [...]
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpihpet0 at acpi0: 23999999 Hz
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2793.55 MHz, 06-55-04,
patch 02007108
cpu0: cpuid 1
edx=bfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
ecx=77fefbff<SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND>
cpu0: cpuid 6 eax=77<SENSOR,ARAT> ecx=9<EFFFREQ>
cpu0: cpuid 7.0
ebx=d39ffffb<FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,MPX,AVX512F,AVX512DQ,RDSEED,ADX,SMAP,CLFLUSHOPT,CLWB,PT,AVX512CD,AVX512BW,AVX512VL>
ecx=8<PKU> edx=bc002400<MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD>
cpu0: cpuid a vers=4, gp=8, gpwidth=48, ff=3, ffwidth=48
cpu0: cpuid d.1 eax=f<XSAVEOPT,XSAVEC,XGETBV1,XSAVES>
cpu0: cpuid 80000001 edx=2c100800<NXE,PAGE1GB,RDTSCP,LONG>
ecx=121<LAHF,ABM,3DNOWP>
cpu0: cpuid 80000007 edx=100<ITSC>
cpu0: msr 10a=2000c04<RSBA,MISC_PKG_CT,ENERGY_FILT,GDS_CTRL>
cpu0: MELTDOWN
cpu0: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 1MB
64b/line 16-way L2 cache, 22MB 64b/line 11-way L3 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
cpu0: apic clock running at 24MHz
cpu0: mwait min=64, max=64, C-substates=0.2.0.2, IBE
cpu1 at mainbus0: apid 32 (application processor)
cpu1: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2791.39 MHz, 06-55-04,
patch 02007108
cpu1: smt 0, core 0, package 1
cpu2 at mainbus0: apid 14 (application processor)
cpu2: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2793.65 MHz, 06-55-04,
patch 02007108
cpu2: smt 0, core 7, package 0
cpu3 at mainbus0: apid 46 (application processor)
cpu3: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2793.76 MHz, 06-55-04,
patch 02007108
cpu3: smt 0, core 7, package 1
cpu4 at mainbus0: apid 2 (application processor)
cpu4: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2793.59 MHz, 06-55-04,
patch 02007108
cpu4: smt 0, core 1, package 0
cpu5 at mainbus0: apid 34 (application processor)
cpu5: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2794.11 MHz, 06-55-04,
patch 02007108
cpu5: smt 0, core 1, package 1
cpu6 at mainbus0: apid 12 (application processor)
cpu6: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2793.88 MHz, 06-55-04,
patch 02007108
cpu6: smt 0, core 6, package 0
cpu7 at mainbus0: apid 44 (application processor)
cpu7: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2793.84 MHz, 06-55-04,
patch 02007108
cpu7: smt 0, core 6, package 1
cpu8 at mainbus0: apid 4 (application processor)
cpu8: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2794.95 MHz, 06-55-04,
patch 02007108
cpu8: smt 0, core 2, package 0
cpu9 at mainbus0: apid 36 (application processor)
cpu9: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2794.84 MHz, 06-55-04,
patch 02007108
cpu9: smt 0, core 2, package 1
cpu10 at mainbus0: apid 10 (application processor)
cpu10: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2795.34 MHz, 06-55-04,
patch 02007108
cpu10: smt 0, core 5, package 0
cpu11 at mainbus0: apid 42 (application processor)
cpu11: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2793.85 MHz, 06-55-04,
patch 02007108
cpu11: smt 0, core 5, package 1
cpu12 at mainbus0: apid 6 (application processor)
cpu12: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2795.03 MHz, 06-55-04,
patch 02007108
cpu12: smt 0, core 3, package 0
cpu13 at mainbus0: apid 38 (application processor)
cpu13: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2794.46 MHz, 06-55-04,
patch 02007108
cpu13: smt 0, core 3, package 1
cpu14 at mainbus0: apid 8 (application processor)
cpu14: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2795.37 MHz, 06-55-04,
patch 02007108
cpu14: smt 0, core 4, package 0
cpu15 at mainbus0: apid 40 (application processor)
cpu15: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2795.14 MHz, 06-55-04,
patch 02007108
cpu15: smt 0, core 4, package 1
cpu16 at mainbus0: apid 16 (application processor)
cpu16: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2794.21 MHz, 06-55-04,
patch 02007108
cpu16: smt 0, core 8, package 0
cpu17 at mainbus0: apid 48 (application processor)
cpu17: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2793.80 MHz, 06-55-04,
patch 02007108
cpu17: smt 0, core 8, package 1
cpu18 at mainbus0: apid 30 (application processor)
cpu18: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2802.69 MHz, 06-55-04,
patch 02007108
cpu18: smt 0, core 15, package 0
cpu19 at mainbus0: apid 62 (application processor)
cpu19: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2795.34 MHz, 06-55-04,
patch 02007108
cpu19: smt 0, core 15, package 1
cpu20 at mainbus0: apid 18 (application processor)
cpu20: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2795.19 MHz, 06-55-04,
patch 02007108
cpu20: smt 0, core 9, package 0
cpu21 at mainbus0: apid 50 (application processor)
cpu21: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2796.45 MHz, 06-55-04,
patch 02007108
cpu21: smt 0, core 9, package 1
cpu22 at mainbus0: apid 28 (application processor)
cpu22: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2796.49 MHz, 06-55-04,
patch 02007108
cpu22: smt 0, core 14, package 0
cpu23 at mainbus0: apid 60 (application processor)
cpu23: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2795.52 MHz, 06-55-04,
patch 02007108
cpu23: smt 0, core 14, package 1
cpu24 at mainbus0: apid 20 (application processor)
cpu24: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2794.21 MHz, 06-55-04,
patch 02007108
cpu24: smt 0, core 10, package 0
cpu25 at mainbus0: apid 52 (application processor)
cpu25: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2796.45 MHz, 06-55-04,
patch 02007108
cpu25: smt 0, core 10, package 1
cpu26 at mainbus0: apid 26 (application processor)
cpu26: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2797.96 MHz, 06-55-04,
patch 02007108
cpu26: smt 0, core 13, package 0
cpu27 at mainbus0: apid 58 (application processor)
cpu27: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2797.56 MHz, 06-55-04,
patch 02007108
cpu27: smt 0, core 13, package 1
cpu28 at mainbus0: apid 22 (application processor)
cpu28: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2797.40 MHz, 06-55-04,
patch 02007108
cpu28: smt 0, core 11, package 0
cpu29 at mainbus0: apid 54 (application processor)
cpu29: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2795.28 MHz, 06-55-04,
patch 02007108
cpu29: smt 0, core 11, package 1
cpu30 at mainbus0: apid 24 (application processor)
cpu30: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2794.98 MHz, 06-55-04,
patch 02007108
cpu30: smt 0, core 12, package 0
cpu31 at mainbus0: apid 56 (application processor)
cpu31: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz, 2798.61 MHz, 06-55-04,
patch 02007108
cpu31: smt 0, core 12, package 1
ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins
ioapic1 at mainbus0: apid 9 pa 0xfec01000, version 20, 8 pins
ioapic2 at mainbus0: apid 10 pa 0xfec08000, version 20, 8 pins
ioapic3 at mainbus0: apid 11 pa 0xfec10000, version 20, 8 pins
ioapic4 at mainbus0: apid 12 pa 0xfec18000, version 20, 8 pins
ioapic5 at mainbus0: apid 15 pa 0xfec20000, version 20, 8 pins
ioapic6 at mainbus0: apid 16 pa 0xfec28000, version 20, 8 pins, can't remap
ioapic7 at mainbus0: apid 17 pa 0xfec30000, version 20, 8 pins, can't remap
ioapic8 at mainbus0: apid 18 pa 0xfec38000, version 20, 8 pins, can't remap
acpimcfg0 at acpi0
acpimcfg0: addr 0x80000000, bus 0-255
acpiprt0 at acpi0: bus 0 (PC00)
acpiprt1 at acpi0: bus -1 (RP17)
acpiprt2 at acpi0: bus -1 (RP18)
acpiprt3 at acpi0: bus -1 (RP19)
acpiprt4 at acpi0: bus -1 (RP20)
acpiprt5 at acpi0: bus 1 (RP01)
acpiprt6 at acpi0: bus -1 (RP02)
acpiprt7 at acpi0: bus -1 (RP03)
acpiprt8 at acpi0: bus -1 (RP04)
acpiprt9 at acpi0: bus 2 (RP05)
acpiprt10 at acpi0: bus -1 (RP06)
acpiprt11 at acpi0: bus -1 (RP07)
acpiprt12 at acpi0: bus -1 (RP08)
acpiprt13 at acpi0: bus -1 (RP09)
acpiprt14 at acpi0: bus -1 (RP10)
acpiprt15 at acpi0: bus -1 (RP11)
acpiprt16 at acpi0: bus -1 (RP12)
acpiprt17 at acpi0: bus -1 (RP13)
acpiprt18 at acpi0: bus -1 (RP14)
acpiprt19 at acpi0: bus -1 (RP15)
acpiprt20 at acpi0: bus -1 (RP16)
acpiprt21 at acpi0: bus 23 (PC01)
acpiprt22 at acpi0: bus 24 (BR1A)
acpiprt23 at acpi0: bus -1 (BR1B)
acpiprt24 at acpi0: bus 25 (BR1C)
acpiprt25 at acpi0: bus -1 (BR1D)
acpiprt26 at acpi0: bus 58 (PC02)
acpiprt27 at acpi0: bus 59 (BR2A)
acpiprt28 at acpi0: bus -1 (BR2B)
acpiprt29 at acpi0: bus -1 (BR2C)
acpiprt30 at acpi0: bus -1 (BR2D)
acpiprt31 at acpi0: bus 93 (PC03)
acpiprt32 at acpi0: bus -1 (BR3A)
acpiprt33 at acpi0: bus -1 (BR3B)
acpiprt34 at acpi0: bus 94 (BR3C)
acpiprt35 at acpi0: bus -1 (BR3D)
acpiprt36 at acpi0: bus 128 (PC06)
acpiprt37 at acpi0: bus -1 (QRP0)
acpiprt38 at acpi0: bus 133 (PC07)
acpiprt39 at acpi0: bus 134 (QR1A)
acpiprt40 at acpi0: bus -1 (QR1B)
acpiprt41 at acpi0: bus 135 (QR1C)
acpiprt42 at acpi0: bus -1 (QR1D)
acpiprt43 at acpi0: bus 174 (PC08)
acpiprt44 at acpi0: bus 175 (QR2A)
acpiprt45 at acpi0: bus -1 (QR2B)
acpiprt46 at acpi0: bus -1 (QR2C)
acpiprt47 at acpi0: bus -1 (QR2D)
acpiprt48 at acpi0: bus 215 (PC09)
acpiprt49 at acpi0: bus 216 (QR3A)
acpiprt50 at acpi0: bus -1 (QR3B)
acpiprt51 at acpi0: bus -1 (QR3C)
acpiprt52 at acpi0: bus -1 (QR3D)
"ACPI0004" at acpi0 not configured
acpicpu0 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu1 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu2 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu3 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu4 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu5 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu6 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu7 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu8 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu9 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu10 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu11 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu12 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu13 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu14 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu15 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
"ACPI0004" at acpi0 not configured
acpicpu16 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu17 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu18 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu19 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu20 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu21 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu22 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu23 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu24 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu25 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu26 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu27 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu28 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu29 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu30 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
acpicpu31 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
"PNP0C33" at acpi0 not configured
acpipci0 at acpi0 PC00: 0x00000000 0x00000011 0x00000001
"PNP0003" at acpi0 not configured
acpicmos0 at acpi0
com1 at acpi0 COMA addr 0x2f8/0x8 irq 3: ns16550a, 16 byte fifo
com0 at acpi0 COMB addr 0x3f8/0x8 irq 4: ns16550a, 16 byte fifo
com0: console
"IPI0001" at acpi0 not configured
acpipci1 at acpi0 PC01: 0x00000000 0x00000011 0x00000001
acpipci2 at acpi0 PC02: 0x00000000 0x00000011 0x00000001
acpipci3 at acpi0 PC03: 0x00000000 0x00000011 0x00000001
acpipci4 at acpi0 PC06: 0x00000000 0x00000011 0x00000001
acpipci5 at acpi0 PC07: 0x00000000 0x00000011 0x00000001
acpipci6 at acpi0 PC08: 0x00000000 0x00000011 0x00000001
acpipci7 at acpi0 PC09: 0x00000000 0x00000011 0x00000001
"PNP0C14" at acpi0 not configured
"INTL0000" at acpi0 not configured
ipmi at mainbus0 not configured
cpu0: using VERW MDS workaround (except on vmm entry)
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel Xeon Scalable Host" rev 0x04
"Intel Xeon Scalable VT-d" rev 0x04 at pci0 dev 5 function 0 not configured
"Intel Xeon Scalable RAS" rev 0x04 at pci0 dev 5 function 2 not configured
"Intel Xeon Scalable I/O APIC" rev 0x04 at pci0 dev 5 function 4 not
configured
"Intel Xeon Scalable Ubox" rev 0x04 at pci0 dev 8 function 0 not configured
"Intel Xeon Scalable Ubox" rev 0x04 at pci0 dev 8 function 1 not configured
"Intel Xeon Scalable Ubox" rev 0x04 at pci0 dev 8 function 2 not configured
"Intel C620 MROM" rev 0x08 at pci0 dev 17 function 0 not configured
ahci0 at pci0 dev 17 function 5 "Intel C620 AHCI" rev 0x08: msi, AHCI 1.3.1
scsibus1 at ahci0: 32 targets
xhci0 at pci0 dev 20 function 0 "Intel C620 xHCI" rev 0x08: msi, xHCI 1.0
usb0 at xhci0: USB revision 3.0
uhub0 at usb0 configuration 1 interface 0 "Intel xHCI root hub" rev
3.00/1.00 addr 1
"Intel C620 Thermal" rev 0x08 at pci0 dev 20 function 2 not configured
"Intel C620 MEI" rev 0x08 at pci0 dev 22 function 0 not configured
"Intel C620 MEI" rev 0x08 at pci0 dev 22 function 1 not configured
"Intel C620 MEI" rev 0x08 at pci0 dev 22 function 4 not configured
ahci1 at pci0 dev 23 function 0 "Intel C620 AHCI" rev 0x08: msi, AHCI 1.3.1
scsibus2 at ahci1: 32 targets
ppb0 at pci0 dev 28 function 0 "Intel C620 PCIE" rev 0xf8: msi
pci1 at ppb0 bus 1
ppb1 at pci0 dev 28 function 4 "Intel C620 PCIE" rev 0xf8: msi
pci2 at ppb1 bus 2
ppb2 at pci2 dev 0 function 0 vendor "PLDA", unknown product 0xbe00 rev 0x02
pci3 at ppb2 bus 3
vga1 at pci3 dev 0 function 0 vendor "Matrox", unknown product 0x0536
rev 0x04
wsdisplay at vga1 not configured
pcib0 at pci0 dev 31 function 0 "Intel C621 LPC" rev 0x08
"Intel C620 Power" rev 0x08 at pci0 dev 31 function 2 not configured
ichiic0 at pci0 dev 31 function 4 "Intel C620 SMBus" rev 0x08: apic 8 int 16
iic0 at ichiic0
ichiic0: abort failed, status 0x41<BUSY,INUSE>
"Intel C620 SPI" rev 0x08 at pci0 dev 31 function 5 not configured
isa0 at pcib0
isadma0 at isa0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
pci4 at mainbus0 bus 23
ppb3 at pci4 dev 0 function 0 "Intel Xeon Scalable PCIE" rev 0x04: msi
pci5 at ppb3 bus 24
mpii0 at pci5 dev 0 function 0 "Symbios Logic SAS3008" rev 0x02: msi
mpii0: Dell HBA330 Adp, firmware 16.0.11.0, MPI 2.5
scsibus3 at mpii0: 544 targets
ppb4 at pci4 dev 2 function 0 "Intel Xeon Scalable PCIE" rev 0x04
pci6 at ppb4 bus 25
mcx0 at pci6 dev 0 function 0 "Mellanox ConnectX-4 Lx" rev 0x00: FW
14.32.2004, msix, address ec:0d:9a:8b:41:f4
mcx1 at pci6 dev 0 function 1 "Mellanox ConnectX-4 Lx" rev 0x00: FW
14.32.2004, msix, address ec:0d:9a:8b:41:f5
"Intel Xeon Scalable VT-d" rev 0x04 at pci4 dev 5 function 0 not configured
"Intel Xeon Scalable RAS" rev 0x04 at pci4 dev 5 function 2 not configured
"Intel Xeon Scalable IOxAPIC" rev 0x04 at pci4 dev 5 function 4 not
configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 8 function 0 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 8 function 1 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 8 function 2 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 8 function 3 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 8 function 4 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 8 function 5 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 8 function 6 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 8 function 7 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 9 function 0 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 9 function 1 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 9 function 2 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 9 function 3 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 9 function 4 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 9 function 5 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 9 function 6 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 9 function 7 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 10 function 0 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 10 function 1 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 10 function 2 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 10 function 3 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 10 function 4 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 10 function 5 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 10 function 6 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 10 function 7 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 11 function 0 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 11 function 1 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 11 function 2 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 11 function 3 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 14 function 0 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 14 function 1 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 14 function 2 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 14 function 3 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 14 function 4 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 14 function 5 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 14 function 6 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 14 function 7 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 15 function 0 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 15 function 1 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 15 function 2 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 15 function 3 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 15 function 4 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 15 function 5 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 15 function 6 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 15 function 7 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 16 function 0 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 16 function 1 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 16 function 2 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 16 function 3 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 16 function 4 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 16 function 5 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 16 function 6 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 16 function 7 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 17 function 0 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 17 function 1 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 17 function 2 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 17 function 3 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 29 function 0 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 29 function 1 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 29 function 2 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci4 dev 29 function 3 not configured
"Intel Xeon Scalable PCU" rev 0x04 at pci4 dev 30 function 0 not configured
"Intel Xeon Scalable PCU" rev 0x04 at pci4 dev 30 function 1 not configured
"Intel Xeon Scalable PCU" rev 0x04 at pci4 dev 30 function 2 not configured
"Intel Xeon Scalable PCU" rev 0x04 at pci4 dev 30 function 3 not configured
"Intel Xeon Scalable PCU" rev 0x04 at pci4 dev 30 function 4 not configured
"Intel Xeon Scalable PCU" rev 0x04 at pci4 dev 30 function 5 not configured
"Intel Xeon Scalable PCU" rev 0x04 at pci4 dev 30 function 6 not configured
pci7 at mainbus0 bus 58
ppb5 at pci7 dev 0 function 0 "Intel Xeon Scalable PCIE" rev 0x04: msi
pci8 at ppb5 bus 59
ppb6 at pci8 dev 0 function 0 "PLX PEX 9733" rev 0xb0
pci9 at ppb6 bus 60
ppb7 at pci9 dev 4 function 0 "PLX PEX 9733" rev 0xb0: msi
pci10 at ppb7 bus 61
ppb8 at pci9 dev 5 function 0 "PLX PEX 9733" rev 0xb0: msi
pci11 at ppb8 bus 62
nvme0 at pci11 dev 0 function 0 "Samsung NVMe" rev 0x01: msix, NVMe 1.2
nvme0: Dell Express Flash PM1725a 800GB SFF, firmware 1.2.1, serial
S39YNX0K201056
scsibus4 at nvme0: 2 targets, initiator 0
sd0 at scsibus4 targ 1 lun 0: <NVMe, Dell Express Fla, 1.2.>
sd0: 763097MB, 512 bytes/sector, 1562824368 sectors
ppb9 at pci9 dev 6 function 0 "PLX PEX 9733" rev 0xb0: msi
pci12 at ppb9 bus 63
ppb10 at pci9 dev 7 function 0 "PLX PEX 9733" rev 0xb0: msi
pci13 at ppb10 bus 64
"Intel Xeon Scalable VT-d" rev 0x04 at pci7 dev 5 function 0 not configured
"Intel Xeon Scalable RAS" rev 0x04 at pci7 dev 5 function 2 not configured
"Intel Xeon Scalable IOxAPIC" rev 0x04 at pci7 dev 5 function 4 not
configured
"Intel Xeon Scalable IMC" rev 0x04 at pci7 dev 8 function 0 not configured
"Intel Xeon Scalable IMC" rev 0x04 at pci7 dev 9 function 0 not configured
"Intel Xeon Scalable IMC" rev 0x04 at pci7 dev 10 function 0 not configured
"Intel Xeon Scalable IMC" rev 0x04 at pci7 dev 10 function 1 not configured
"Intel Xeon Scalable IMC" rev 0x04 at pci7 dev 10 function 2 not configured
"Intel Xeon Scalable IMC" rev 0x04 at pci7 dev 10 function 3 not configured
"Intel Xeon Scalable IMC" rev 0x04 at pci7 dev 10 function 4 not configured
"Intel Xeon Scalable LM" rev 0x04 at pci7 dev 10 function 5 not configured
"Intel Xeon Scalable LMS" rev 0x04 at pci7 dev 10 function 6 not configured
"Intel Xeon Scalable LMDP" rev 0x04 at pci7 dev 10 function 7 not configured
"Intel Xeon Scalable DECS" rev 0x04 at pci7 dev 11 function 0 not configured
"Intel Xeon Scalable LM" rev 0x04 at pci7 dev 11 function 1 not configured
"Intel Xeon Scalable LMS" rev 0x04 at pci7 dev 11 function 2 not configured
"Intel Xeon Scalable LMDP" rev 0x04 at pci7 dev 11 function 3 not configured
"Intel Xeon Scalable IMC" rev 0x04 at pci7 dev 12 function 0 not configured
"Intel Xeon Scalable IMC" rev 0x04 at pci7 dev 12 function 1 not configured
"Intel Xeon Scalable IMC" rev 0x04 at pci7 dev 12 function 2 not configured
"Intel Xeon Scalable IMC" rev 0x04 at pci7 dev 12 function 3 not configured
"Intel Xeon Scalable IMC" rev 0x04 at pci7 dev 12 function 4 not configured
"Intel Xeon Scalable LM" rev 0x04 at pci7 dev 12 function 5 not configured
"Intel Xeon Scalable LMS" rev 0x04 at pci7 dev 12 function 6 not configured
"Intel Xeon Scalable LMDP" rev 0x04 at pci7 dev 12 function 7 not configured
"Intel Xeon Scalable DECS" rev 0x04 at pci7 dev 13 function 0 not configured
"Intel Xeon Scalable LM" rev 0x04 at pci7 dev 13 function 1 not configured
"Intel Xeon Scalable LMS" rev 0x04 at pci7 dev 13 function 2 not configured
"Intel Xeon Scalable LMDP" rev 0x04 at pci7 dev 13 function 3 not configured
pci14 at mainbus0 bus 93
ppb11 at pci14 dev 2 function 0 "Intel Xeon Scalable PCIE" rev 0x04: msi
pci15 at ppb11 bus 94
em0 at pci15 dev 0 function 0 "Intel I350" rev 0x01: msi, address
50:7c:6f:4b:52:24
em1 at pci15 dev 0 function 1 "Intel I350" rev 0x01: msi, address
50:7c:6f:4b:52:25
"Intel Xeon Scalable VT-d" rev 0x04 at pci14 dev 5 function 0 not configured
"Intel Xeon Scalable RAS" rev 0x04 at pci14 dev 5 function 2 not configured
"Intel Xeon Scalable IOxAPIC" rev 0x04 at pci14 dev 5 function 4 not
configured
"Intel Xeon Scalable KTI" rev 0x04 at pci14 dev 14 function 0 not configured
"Intel Xeon Scalable UPI" rev 0x04 at pci14 dev 14 function 1 not configured
"Intel Xeon Scalable KTI" rev 0x04 at pci14 dev 15 function 0 not configured
"Intel Xeon Scalable UPI" rev 0x04 at pci14 dev 15 function 1 not configured
"Intel Xeon Scalable KTI" rev 0x04 at pci14 dev 16 function 0 not configured
"Intel Xeon Scalable UPI" rev 0x04 at pci14 dev 16 function 1 not configured
"Intel Xeon Scalable M3KTI" rev 0x04 at pci14 dev 18 function 0 not
configured
"Intel Xeon Scalable M3KTI" rev 0x04 at pci14 dev 18 function 1 not
configured
"Intel Xeon Scalable M3KTI" rev 0x04 at pci14 dev 18 function 2 not
configured
"Intel Xeon Scalable M3KTI" rev 0x04 at pci14 dev 18 function 4 not
configured
"Intel Xeon Scalable M3KTI" rev 0x04 at pci14 dev 18 function 5 not
configured
"Intel Xeon Scalable M2PCI" rev 0x04 at pci14 dev 21 function 0 not
configured
"Intel Xeon Scalable M2PCI" rev 0x04 at pci14 dev 22 function 0 not
configured
"Intel Xeon Scalable M2PCI" rev 0x04 at pci14 dev 22 function 4 not
configured
"Intel Xeon Scalable M2PCI" rev 0x04 at pci14 dev 23 function 0 not
configured
pci16 at mainbus0 bus 128
"Intel Xeon Scalable VT-d" rev 0x04 at pci16 dev 5 function 0 not configured
"Intel Xeon Scalable RAS" rev 0x04 at pci16 dev 5 function 2 not configured
"Intel Xeon Scalable I/O APIC" rev 0x04 at pci16 dev 5 function 4 not
configured
"Intel Xeon Scalable Ubox" rev 0x04 at pci16 dev 8 function 0 not configured
"Intel Xeon Scalable Ubox" rev 0x04 at pci16 dev 8 function 1 not configured
"Intel Xeon Scalable Ubox" rev 0x04 at pci16 dev 8 function 2 not configured
pci17 at mainbus0 bus 133
ppb12 at pci17 dev 0 function 0 "Intel Xeon Scalable PCIE" rev 0x04: msi
pci18 at ppb12 bus 134
bge0 at pci18 dev 0 function 0 "Broadcom BCM5720" rev 0x00, BCM5720 A0
(0x5720000), APE firmware NCSI 1.5.49.0: msi, address 00:10:18:c1:e4:e2
brgphy0 at bge0 phy 1: BCM5720C 10/100/1000baseT PHY, rev. 0
bge1 at pci18 dev 0 function 1 "Broadcom BCM5720" rev 0x00, BCM5720 A0
(0x5720000), APE firmware NCSI 1.5.49.0: msi, address 00:10:18:c1:e4:e3
brgphy1 at bge1 phy 2: BCM5720C 10/100/1000baseT PHY, rev. 0
ppb13 at pci17 dev 2 function 0 "Intel Xeon Scalable PCIE" rev 0x04: msi
pci19 at ppb13 bus 135
ixl0 at pci19 dev 0 function 0 "Intel X710 SFP+" rev 0x02: port 0, FW
9.820.73026 API 1.15, msix, 8 queues, address f8:f2:1e:6f:4e:f0
ixl1 at pci19 dev 0 function 1 "Intel X710 SFP+" rev 0x02: port 1, FW
9.820.73026 API 1.15, msix, 8 queues, address f8:f2:1e:6f:4e:f1
"Intel Xeon Scalable VT-d" rev 0x04 at pci17 dev 5 function 0 not configured
"Intel Xeon Scalable RAS" rev 0x04 at pci17 dev 5 function 2 not configured
"Intel Xeon Scalable IOxAPIC" rev 0x04 at pci17 dev 5 function 4 not
configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 8 function 0 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 8 function 1 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 8 function 2 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 8 function 3 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 8 function 4 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 8 function 5 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 8 function 6 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 8 function 7 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 9 function 0 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 9 function 1 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 9 function 2 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 9 function 3 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 9 function 4 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 9 function 5 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 9 function 6 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 9 function 7 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 10 function 0 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 10 function 1 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 10 function 2 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 10 function 3 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 10 function 4 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 10 function 5 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 10 function 6 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 10 function 7 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 11 function 0 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 11 function 1 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 11 function 2 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 11 function 3 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 14 function 0 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 14 function 1 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 14 function 2 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 14 function 3 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 14 function 4 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 14 function 5 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 14 function 6 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 14 function 7 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 15 function 0 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 15 function 1 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 15 function 2 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 15 function 3 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 15 function 4 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 15 function 5 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 15 function 6 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 15 function 7 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 16 function 0 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 16 function 1 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 16 function 2 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 16 function 3 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 16 function 4 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 16 function 5 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 16 function 6 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 16 function 7 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 17 function 0 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 17 function 1 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 17 function 2 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 17 function 3 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 29 function 0 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 29 function 1 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 29 function 2 not configured
"Intel Xeon Scalable CHA" rev 0x04 at pci17 dev 29 function 3 not configured
"Intel Xeon Scalable PCU" rev 0x04 at pci17 dev 30 function 0 not configured
"Intel Xeon Scalable PCU" rev 0x04 at pci17 dev 30 function 1 not configured
"Intel Xeon Scalable PCU" rev 0x04 at pci17 dev 30 function 2 not configured
"Intel Xeon Scalable PCU" rev 0x04 at pci17 dev 30 function 3 not configured
"Intel Xeon Scalable PCU" rev 0x04 at pci17 dev 30 function 4 not configured
"Intel Xeon Scalable PCU" rev 0x04 at pci17 dev 30 function 5 not configured
"Intel Xeon Scalable PCU" rev 0x04 at pci17 dev 30 function 6 not configured
pci20 at mainbus0 bus 174
ppb14 at pci20 dev 0 function 0 "Intel Xeon Scalable PCIE" rev 0x04: msi
pci21 at ppb14 bus 175
bnxt0 at pci21 dev 0 function 0 "Broadcom BCM57414" rev 0x01: fw ver
214.4.91, msix, 8 queues, address e4:3d:1a:d6:81:00
bnxt1 at pci21 dev 0 function 1 "Broadcom BCM57414" rev 0x01: fw ver
214.4.91, msix, 8 queues, address e4:3d:1a:d6:81:01
"Intel Xeon Scalable VT-d" rev 0x04 at pci20 dev 5 function 0 not configured
"Intel Xeon Scalable RAS" rev 0x04 at pci20 dev 5 function 2 not configured
"Intel Xeon Scalable IOxAPIC" rev 0x04 at pci20 dev 5 function 4 not
configured
"Intel Xeon Scalable IMC" rev 0x04 at pci20 dev 8 function 0 not configured
"Intel Xeon Scalable IMC" rev 0x04 at pci20 dev 9 function 0 not configured
"Intel Xeon Scalable IMC" rev 0x04 at pci20 dev 10 function 0 not configured
"Intel Xeon Scalable IMC" rev 0x04 at pci20 dev 10 function 1 not configured
"Intel Xeon Scalable IMC" rev 0x04 at pci20 dev 10 function 2 not configured
"Intel Xeon Scalable IMC" rev 0x04 at pci20 dev 10 function 3 not configured
"Intel Xeon Scalable IMC" rev 0x04 at pci20 dev 10 function 4 not configured
"Intel Xeon Scalable LM" rev 0x04 at pci20 dev 10 function 5 not configured
"Intel Xeon Scalable LMS" rev 0x04 at pci20 dev 10 function 6 not configured
"Intel Xeon Scalable LMDP" rev 0x04 at pci20 dev 10 function 7 not
configured
"Intel Xeon Scalable DECS" rev 0x04 at pci20 dev 11 function 0 not
configured
"Intel Xeon Scalable LM" rev 0x04 at pci20 dev 11 function 1 not configured
"Intel Xeon Scalable LMS" rev 0x04 at pci20 dev 11 function 2 not configured
"Intel Xeon Scalable LMDP" rev 0x04 at pci20 dev 11 function 3 not
configured
"Intel Xeon Scalable IMC" rev 0x04 at pci20 dev 12 function 0 not configured
"Intel Xeon Scalable IMC" rev 0x04 at pci20 dev 12 function 1 not configured
"Intel Xeon Scalable IMC" rev 0x04 at pci20 dev 12 function 2 not configured
"Intel Xeon Scalable IMC" rev 0x04 at pci20 dev 12 function 3 not configured
"Intel Xeon Scalable IMC" rev 0x04 at pci20 dev 12 function 4 not configured
"Intel Xeon Scalable LM" rev 0x04 at pci20 dev 12 function 5 not configured
"Intel Xeon Scalable LMS" rev 0x04 at pci20 dev 12 function 6 not configured
"Intel Xeon Scalable LMDP" rev 0x04 at pci20 dev 12 function 7 not
configured
"Intel Xeon Scalable DECS" rev 0x04 at pci20 dev 13 function 0 not
configured
"Intel Xeon Scalable LM" rev 0x04 at pci20 dev 13 function 1 not configured
"Intel Xeon Scalable LMS" rev 0x04 at pci20 dev 13 function 2 not configured
"Intel Xeon Scalable LMDP" rev 0x04 at pci20 dev 13 function 3 not
configured
pci22 at mainbus0 bus 215
ppb15 at pci22 dev 0 function 0 "Intel Xeon Scalable PCIE" rev 0x04: msi
pci23 at ppb15 bus 216
ix0 at pci23 dev 0 function 0 "Intel 82599" rev 0x01, msix, 16 queues,
address a0:36:9f:d0:a1:38
ix1 at pci23 dev 0 function 1 "Intel 82599" rev 0x01, msix, 16 queues,
address a0:36:9f:d0:a1:3a
"Intel Xeon Scalable VT-d" rev 0x04 at pci22 dev 5 function 0 not configured
"Intel Xeon Scalable RAS" rev 0x04 at pci22 dev 5 function 2 not configured
"Intel Xeon Scalable IOxAPIC" rev 0x04 at pci22 dev 5 function 4 not
configured
"Intel Xeon Scalable KTI" rev 0x04 at pci22 dev 14 function 0 not configured
"Intel Xeon Scalable UPI" rev 0x04 at pci22 dev 14 function 1 not configured
"Intel Xeon Scalable KTI" rev 0x04 at pci22 dev 15 function 0 not configured
"Intel Xeon Scalable UPI" rev 0x04 at pci22 dev 15 function 1 not configured
"Intel Xeon Scalable KTI" rev 0x04 at pci22 dev 16 function 0 not configured
"Intel Xeon Scalable UPI" rev 0x04 at pci22 dev 16 function 1 not configured
"Intel Xeon Scalable M3KTI" rev 0x04 at pci22 dev 18 function 0 not
configured
"Intel Xeon Scalable M3KTI" rev 0x04 at pci22 dev 18 function 1 not
configured
"Intel Xeon Scalable M3KTI" rev 0x04 at pci22 dev 18 function 2 not
configured
"Intel Xeon Scalable M3KTI" rev 0x04 at pci22 dev 18 function 4 not
configured
"Intel Xeon Scalable M3KTI" rev 0x04 at pci22 dev 18 function 5 not
configured
"Intel Xeon Scalable M2PCI" rev 0x04 at pci22 dev 21 function 0 not
configured
"Intel Xeon Scalable M2PCI" rev 0x04 at pci22 dev 22 function 0 not
configured
"Intel Xeon Scalable M2PCI" rev 0x04 at pci22 dev 22 function 4 not
configured
"Intel Xeon Scalable M2PCI" rev 0x04 at pci22 dev 23 function 0 not
configured
vmm0 at mainbus0: VMX/EPT
efifb0 at mainbus0: 1280x1024, 32bpp
wsdisplay0 at efifb0 mux 1
wsdisplay0: screen 0-5 added (std, vt100 emulation)
sd1 at scsibus3 targ 0 lun 0: <ATA, SAMSUNG MZ7KM1T9, 003Q>
naa.5002538c403dc154
sd1: 1831420MB, 512 bytes/sector, 3750748848 sectors, thin
ses0 at scsibus3 targ 40 lun 0: <DP, BP14G+EXP, 2.52> naa.500056b32e0918fd
uhub1 at uhub0 port 14 configuration 1 interface 0 "vendor 0x1604
product 0x10c0" rev 2.00/0.00 addr 2
uhub2 at uhub1 port 1 configuration 1 interface 0 "vendor 0x1604 product
0x10c0" rev 2.00/0.00 addr 3
uhidev0 at uhub1 port 2 configuration 1 interface 0 "DELL DRAC 5 Virtual
Keyboard and Mouse" rev 2.00/0.00 addr 4
uhidev0: iclass 3/1
ums0 at uhidev0: 3 buttons, Z dir
wsmouse0 at ums0 mux 0
uhidev1 at uhub1 port 2 configuration 1 interface 1 "DELL DRAC 5 Virtual
Keyboard and Mouse" rev 2.00/0.00 addr 4
uhidev1: iclass 3/1
ukbd0 at uhidev1: 8 variable keys, 6 key codes
wskbd0 at ukbd0 mux 1
wskbd0: connecting to wsdisplay0
uhub3 at uhub1 port 4 configuration 1 interface 0 "vendor 0x1604 product
0x10c0" rev 2.00/0.00 addr 5
vscsi0 at root
scsibus5 at vscsi0: 256 targets
softraid0 at root
scsibus6 at softraid0: 256 targets
root on sd0a (5bd2a08dcdc85094.a) swap on sd0b dump on sd0b
WARNING: / was not properly unmounted
load averages: 13.17, 12.11, 11.09
bigi.netlab 00:00:19
87 threads: 1 running, 54 idle, 32 on processor up 0
days 00:33:33
CPU00 states: 0.0% user, 0.0% nice, 0.0% sys, 68.6% spin, 30.8% intr, 0.6%
idle
CPU01 states: 0.0% user, 0.0% nice, 22.9% sys, 62.7% spin, 3.9% intr, 10.5%
idle
CPU02 states: 0.0% user, 0.0% nice, 26.1% sys, 40.5% spin, 2.0% intr, 31.4%
idle
CPU03 states: 0.0% user, 0.0% nice, 43.4% sys, 27.0% spin, 2.0% intr, 27.6%
idle
CPU04 states: 0.0% user, 0.0% nice, 9.4% sys, 73.8% spin, 2.7% intr, 14.1%
idle
CPU05 states: 0.0% user, 0.0% nice, 50.3% sys, 17.2% spin, 5.5% intr, 26.9%
idle
CPU06 states: 0.0% user, 0.0% nice, 49.6% sys, 5.0% spin, 3.6% intr, 41.7%
idle
CPU07 states: 0.0% user, 0.0% nice, 33.8% sys, 39.1% spin, 4.5% intr, 22.6%
idle
CPU08 states: 0.0% user, 0.0% nice, 38.2% sys, 15.3% spin, 4.6% intr, 42.0%
idle
CPU09 states: 0.0% user, 0.0% nice, 75.0% sys, 2.5% spin, 5.0% intr, 17.5%
idle
CPU10 states: 0.0% user, 0.0% nice, 58.3% sys, 7.4% spin, 6.5% intr, 27.8%
idle
CPU11 states: 0.0% user, 0.0% nice, 36.2% sys, 37.1% spin, 5.7% intr, 21.0%
idle
CPU12 states: 0.0% user, 0.0% nice, 42.7% sys, 9.7% spin, 2.9% intr, 44.7%
idle
CPU13 states: 0.0% user, 0.0% nice, 46.2% sys, 11.5% spin, 0.0% intr, 42.3%
idle
CPU14 states: 0.0% user, 0.0% nice, 41.9% sys, 4.8% spin, 3.8% intr, 49.5%
idle
CPU15 states: 0.0% user, 0.0% nice, 52.4% sys, 1.9% spin, 5.8% intr, 39.8%
idle
CPU16 states: 0.0% user, 0.0% nice, 14.0% sys, 9.3% spin, 0.0% intr, 76.6%
idle
CPU17 states: 0.0% user, 0.0% nice, 16.5% sys, 20.4% spin, 10.7% intr, 52.4%
idle
CPU18 states: 0.0% user, 0.0% nice, 8.7% sys, 16.5% spin, 19.4% intr, 55.3%
idle
CPU19 states: 0.0% user, 0.0% nice, 13.6% sys, 27.2% spin, 6.8% intr, 52.4%
idle
CPU20 states: 0.0% user, 0.0% nice, 0.0% sys, 17.5% spin, 17.5% intr, 65.0%
idle
CPU21 states: 0.0% user, 0.0% nice, 0.0% sys, 17.3% spin, 11.5% intr, 71.2%
idle
CPU22 states: 0.0% user, 0.0% nice, 0.0% sys, 16.3% spin, 14.4% intr, 69.2%
idle
CPU23 states: 0.0% user, 0.0% nice, 0.0% sys, 16.3% spin, 13.5% intr, 70.2%
idle
CPU24 states: 0.0% user, 0.0% nice, 0.0% sys, 16.5% spin, 3.9% intr, 79.6%
idle
CPU25 states: 0.0% user, 0.0% nice, 0.0% sys, 11.8% spin, 11.8% intr, 76.5%
idle
CPU26 states: 0.0% user, 0.0% nice, 0.0% sys, 16.8% spin, 19.8% intr, 63.4%
idle
CPU27 states: 0.0% user, 0.0% nice, 0.0% sys, 10.7% spin, 9.7% intr, 79.6%
idle
CPU28 states: 0.0% user, 0.0% nice, 0.0% sys, 16.0% spin, 8.5% intr, 75.5%
idle
CPU29 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU30 states: 0.0% user, 0.0% nice, 0.0% sys, 20.6% spin, 8.8% intr, 70.6%
idle
CPU31 states: 0.0% user, 0.0% nice, 0.0% sys, 14.3% spin, 11.4% intr, 74.3%
idle
Memory: Real: 184K/2798M act/tot Free: 368G Cache: 903M Swap: 0K/74G
PID TID PRI NICE SIZE RES STATE WAIT TIME CPU COMMAND
52013 122790 -18 0 0K 1744K sleep/1 pgdaemo 30:26 96.58% pagedaemon
83992 393457 64 0 0K 1744K onproc/12 - 20:25 60.69% softnet1
5880 554402 14 0 0K 1744K sleep/5 netlock 19:50 59.57% softnet5
29891 358769 10 0 0K 1744K sleep/16 bored 19:40 59.18% softnet9
67610 565268 64 0 0K 1744K onproc/9 - 19:35 58.98% softnet11
82076 231775 10 0 0K 1744K sleep/10 bored 19:24 57.37% softnet7
77553 243891 14 0 0K 1744K sleep/6 netlock 18:34 56.98% softnet15
16904 242230 64 0 0K 1744K onproc/2 - 19:23 56.49% softnet13
11518 366671 10 0 0K 1744K sleep/7 bored 19:29 54.93% softnet6
18853 467167 64 0 0K 1744K onproc/17 - 18:47 54.69% softnet4
66965 544940 28 0 0K 1744K run/2 - 20:30 54.05% sensors
30044 397934 64 0 0K 1744K onproc/4 - 19:21 53.91% softnet10
54929 451896 10 0 0K 1744K sleep/5 bored 18:53 53.76% softnet12
55077 188986 10 0 0K 1744K sleep/15 bored 19:14 53.42% softnet14
95329 201862 10 0 0K 1744K sleep/14 bored 19:34 52.78% softnet2
58926 534739 10 0 0K 1744K sleep/6 bored 19:13 51.81% softnet8
97757 206720 28 0 2244K 660K onproc/3 - 0:14 35.35% top
55118 491321 18 0 0K 1744K sleep/6 syncer 3:08 2.20% update
1000 619412 10 0 0K 1744K sleep/6 netlock 2:23 1.76% softnet0
bigi# uvm_fault(p0auxnvfimcff_:fff af uf lf t8 ( 0x 2f5 f8 ff fa f6 f0 f, f 8
2 5 8 f a
6 0, 0 x 8 , 0 , 1) -
0 > x1 8 , 0k e,r n e l d i a g n o s tic a s s e r
t i o n
" ( ( f l a g s & P G O_ L O C K E D) ! = 0
&& r w
_ l o ck _ h
e l2de()
ok-ber>jn ->el :v m o b j l o c k ) ) || ( f l a g s &
P G O _ L
O C KED) == 0" f a i l e d : f i l e " /s
y s /u v
m /pua vgm e _e
o kdfeear.uncle"tl:, p ag le in fae u l t9 5 3
Stopped at db_enter+0x14: popq %rbp
TID PID UID PRFLAGS PFLAGS CPU COMMAND
47778 90797 83 0x19100012 0 3 ntpd
*387038 36184 73 0x19100010 0 5 syslogd
22790 52013 0 0x14000 0x200 12 pagedaemon
444940 66965 0 0x14000 0x40000200 24 sensors
143891 77553 0 0x14000 0x200 4 softnet15
88986 55077 0 0x14000 0x200 6 softnet14
142230 16904 0 0x14000 0x200 14 softnet13
351896 54929 0 0x14000 0x200 10 softnet12
297934 30044 0 0x14000 0x200 11 softnet10
434739 58926 0 0x14000 0x200 9 softnet8
131775 82076 0 0x14000 0x200 13 softnet7
266671 11518 0 0x14000 0x200 2 softnet6
367167 18853 0 0x14000 0x200 7 softnet4
519412 1000 0 0x14000 0x200 1 softnet0
db_enter() at db_enter+0x14
panic(ffffffff82210143) at panic+0xc3
__assert(ffffffff821c869c,ffffffff8221a660,3b9,ffffffff821e89b6) at __assert+0x
29
uvn_get(fffffdd9e5a41940,d7000,ffff80005c3aa1d0,ffff80005c3aa06c,3,4,226f342e33
64f4c8,ffff80005c3aa288) at uvn_get+0x2d4
uvm_fault_lower_lookup(ffff80005c3aa250,ffff80005c3aa288,ffff80005c3aa1d0) at u
vm_fault_lower_lookup+0xcb
uvm_fault_lower(ffff80005c3aa250,ffff80005c3aa288,ffff80005c3aa1d0,0) at uvm_fa
ult_lower+0x4b
uvm_fault(fffffd83e6262d70,e53cae25000,0,4) at uvm_fault+0x1b1
upageflttrap(ffff80005c3aa3b0,e53cae25c7b) at upageflttrap+0x6c
usertrap(ffff80005c3aa3b0) at usertrap+0x1eb
recall_trap() at recall_trap+0x8
end of kernel
end trace frame: 0x7ee189e1ed70, count: 5
https://www.openbsd.org/ddb.html describes the minimum info required in bug
reports. Insufficient info makes it difficult to find and fix bugs.
ddb{5}>
ddb{5}> show panic
cpu26: uvm_fault(0xffffffff8258fa60, 0x8, 0, 1) -> e
*cpu24: uvm_fault(0xffffffff8258fa60, 0x18, 0, 2) -> e
cpu5: kernel diagnostic assertion "((flags & PGO_LOCKED) != 0 && rw_lock_held(
uobj->vmobjlock)) || (flags & PGO_LOCKED) == 0" failed: file "/sys/uvm/uvm_vnod
e.c", line 953
ddb{5}>
ddb{5}> trace
db_enter() at db_enter+0x14
panic(ffffffff82210143) at panic+0xc3
__assert(ffffffff821c869c,ffffffff8221a660,3b9,ffffffff821e89b6) at
__assert+0x29
uvn_get(fffffdd9e5a41940,d7000,ffff80005c3aa1d0,ffff80005c3aa06c,3,4,226f342e33
64f4c8,ffff80005c3aa288) at uvn_get+0x2d4
uvm_fault_lower_lookup(ffff80005c3aa250,ffff80005c3aa288,ffff80005c3aa1d0) at u
vm_fault_lower_lookup+0xcb
uvm_fault_lower(ffff80005c3aa250,ffff80005c3aa288,ffff80005c3aa1d0,0) at uvm_fa
ult_lower+0x4b
uvm_fault(fffffd83e6262d70,e53cae25000,0,4) at uvm_fault+0x1b1
upageflttrap(ffff80005c3aa3b0,e53cae25c7b) at upageflttrap+0x6c
usertrap(ffff80005c3aa3b0) at usertrap+0x1eb
recall_trap() at recall_trap+0x8
end of kernel
end trace frame: 0x7ee189e1ed70, count: -10
ddb{5}>
ddb{5}> show reg
rdi 0
rsi 0x14
rbp 0xffff80005c3a9ef0
rbx 0x3
rdx 0xfe00000000000003
rcx 0x202
rax 0xad
r8 0x101010101010101
r9 0
r10 0x2ddb0e22d32a4ba6
r11 0x977e4a09904e399e
r12 0xffff800055360b78
r13 0xd7000 acpi_pdirpa+0xc2e71
r14 0xffff80005540bb78
r15 0xffffffff82210143 substchar+0x489dd
rip 0xffffffff8104d624 db_enter+0x14
cs 0x8
rflags 0x282
rsp 0xffff80005c3a9ef0
ss 0
db_enter+0x14: popq %rbp
ddb{5}>
ddb{5}> ps
PID TID PPID UID S FLAGS WAIT COMMAND
73961 496893 1 0 3 0x8100083 ttyin ksh
69541 305071 1 0 3 0x18100083 ttyin getty
39092 119576 1 0 3 0x18100083 ttyin getty
59030 168283 1 0 3 0x18100083 ttyin getty
68714 272804 1 0 3 0x18100083 ttyin getty
31412 419658 1 0 3 0x18100083 ttyin getty
14521 190682 1 0 3 0x18100098 kqread cron
18560 99580 39237 95 3 0x19100092 kqread smtpd
62303 83759 39237 103 3 0x19100092 kqread smtpd
12526 153934 39237 95 3 0x19100092 kqread smtpd
3890 76900 39237 95 3 0x18100092 kqread smtpd
74380 453000 39237 95 3 0x19100092 kqread smtpd
5084 276006 39237 95 3 0x19100092 kqread smtpd
39237 383170 1 0 3 0x18100080 kqread smtpd
28130 303112 1 0 3 0x18000088 kqread sshd
90477 60448 1 0 3 0x18100080 kqread ntpd
37683 48744 90797 83 3 0x18100092 kqread ntpd
90797 47778 1 83 7 0x19100012 ntpd
*36184 387038 11593 73 7 0x19100010 syslogd
11593 246105 1 0 3 0x18100082 sbwait syslogd
64969 52131 0 0 3 0x14200 bored smr
37661 388803 0 0 3 0x14200 pgzero zerothread
36622 128169 0 0 3 0x14200 aiodoned aiodoned
55118 391321 0 0 3 0x14200 syncer update
58807 213338 0 0 3 0x14200 cleaner cleaner
47 367219 0 0 3 0x14200 reaper reaper
52013 22790 0 0 7 0x14200 pagedaemon
91256 145206 0 0 3 0x14200 bored wsdisplay0
16074 8771 0 0 3 0x14200 usbtsk usbtask
93673 227746 0 0 3 0x14200 usbatsk usbatsk
37886 430035 0 0 3 0x40014200 acpi0 acpi0
9998 364682 0 0 7 0x40014200 idle31
96598 210590 0 0 7 0x40014200 idle30
93762 269483 0 0 7 0x40014200 idle29
90852 142989 0 0 7 0x40014200 idle28
24647 242079 0 0 7 0x40014200 idle27
83733 405042 0 0 7 0x40014200 idle26
20534 342950 0 0 7 0x40014200 idle25
22159 113423 0 0 3 0x40014200 idle24
25724 234934 0 0 7 0x40014200 idle23
72134 173965 0 0 7 0x40014200 idle22
6192 303767 0 0 7 0x40014200 idle21
79555 494926 0 0 7 0x40014200 idle20
5055 294125 0 0 7 0x40014200 idle19
45250 522489 0 0 7 0x40014200 idle18
68572 47842 0 0 7 0x40014200 idle17
69889 456104 0 0 7 0x40014200 idle16
21099 27032 0 0 7 0x40014200 idle15
25836 483993 0 0 3 0x40014200 idle14
12600 454619 0 0 3 0x40014200 idle13
10907 213359 0 0 3 0x40014200 idle12
16927 103837 0 0 3 0x40014200 idle11
96084 403807 0 0 3 0x40014200 idle10
49377 17292 0 0 3 0x40014200 idle9
502 45290 0 0 7 0x40014200 idle8
81294 267689 0 0 3 0x40014200 idle7
36301 96241 0 0 3 0x40014200 idle6
20956 163567 0 0 3 0x40014200 idle5
34124 411704 0 0 3 0x40014200 idle4
35232 218606 0 0 3 0x40014200 idle3
41824 274824 0 0 3 0x40014200 idle2
93143 48466 0 0 3 0x40014200 idle1
66965 444940 0 0 7 0x40014200 sensors
77553 143891 0 0 7 0x14200 softnet15
55077 88986 0 0 7 0x14200 softnet14
16904 142230 0 0 7 0x14200 softnet13
54929 351896 0 0 7 0x14200 softnet12
67610 465268 0 0 3 0x14200 bored softnet11
30044 297934 0 0 7 0x14200 softnet10
29891 258769 0 0 3 0x14200 bored softnet9
58926 434739 0 0 7 0x14200 softnet8
82076 131775 0 0 7 0x14200 softnet7
11518 266671 0 0 7 0x14200 softnet6
5880 454402 0 0 3 0x14200 bored softnet5
18853 367167 0 0 7 0x14200 softnet4
48561 92399 0 0 3 0x14200 bored softnet3
95329 101862 0 0 3 0x14200 bored softnet2
83992 293457 0 0 3 0x14200 bored softnet1
1000 519412 0 0 7 0x14200 softnet0
1949 227517 0 0 3 0x14200 bored systqmp
64433 482115 0 0 3 0x14200 bored systq
24558 359333 0 0 3 0x14200 tmoslp softclockmp
51903 86322 0 0 2 0x40014200 softclock
74488 187160 0 0 7 0x40014200 idle0
1 505929 0 0 3 0x8000082 wait init
0 0 -1 0 3 0x10200 scheduler swapper
ddb{5}> ps /o
TID PID UID PRFLAGS PFLAGS CPU COMMAND
47778 90797 83 0x19100012 0 3 ntpd
*387038 36184 73 0x19100010 0 5 syslogd
22790 52013 0 0x14000 0x200 12 pagedaemon
444940 66965 0 0x14000 0x40000200 24 sensors
143891 77553 0 0x14000 0x200 4 softnet15
88986 55077 0 0x14000 0x200 6 softnet14
142230 16904 0 0x14000 0x200 14 softnet13
351896 54929 0 0x14000 0x200 10 softnet12
297934 30044 0 0x14000 0x200 11 softnet10
434739 58926 0 0x14000 0x200 9 softnet8
131775 82076 0 0x14000 0x200 13 softnet7
266671 11518 0 0x14000 0x200 2 softnet6
367167 18853 0 0x14000 0x200 7 softnet4
519412 1000 0 0x14000 0x200 1 softnet0
ddb{5}> trace /t 0t47778
end trace frame: 0x0, count: -1
ddb{5}> trace /t 0t387038
kernel: protection fault trap, code=0
Faulted in DDB; continuing...
ddb{5}> trace /t 0t22790
ffffffff821e75e3(uvm_fault(0xfffffd83e6262d70, 0x2, 0, 1) -> e
kernel: page fault trap, code=0
Faulted in DDB; continuing...
ddb{5}> trace /t 0t444940
sched_peg_curproc(ffff80005540aff0) at sched_peg_curproc+0x55
cpu_hz_update_sensor(ffff80005540aff0) at cpu_hz_update_sensor+0x21
sensor_task_work(ffff800000a49b00) at sensor_task_work+0x48
taskq_thread(ffff800000a36d00) at taskq_thread+0x100
end trace frame: 0x0, count: -4
ddb{5}> trace /t 0t143891
end trace frame: 0x0, count: -1
ddb{5}> trace /t 0t88986
end trace frame: 0x0, count: -1
ddb{5}> trace /t 0t142230
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
mtx_enter(ffff800000037698) at mtx_enter+0x28
msleep(ffff800000037680,ffff800000037698,20,ffffffff8220b73d,0) at msleep+0x10d
taskq_next_work(ffff800000037680,ffff80005c2462b0) at taskq_next_work+0x61
taskq_thread(ffff800000037680) at taskq_thread+0xeb
end trace frame: 0x0, count: -5
ddb{5}> trace /t 0t351896
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
mtx_enter(ffff800000037618) at mtx_enter+0x28
msleep(ffff800000037600,ffff800000037618,20,ffffffff8220b73d,0) at msleep+0x10d
taskq_next_work(ffff800000037600,ffff80005c2403d0) at taskq_next_work+0x61
taskq_thread(ffff800000037600) at taskq_thread+0xeb
end trace frame: 0x0, count: -5
ddb{5}> trace /t 0t297934
kernel: protection fault trap, code=0
Faulted in DDB; continuing...
ddb{5}> trace /t 0t434739
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
msleep_nsec(ffff800000037400,ffff800000037418,20,ffffffff8220b73d,fffffffffffff
fff) at msleep_nsec+0xc4
taskq_next_work(ffff800000037400,ffff80005c2284e0) at taskq_next_work+0x61
taskq_thread(ffff800000037400) at taskq_thread+0xeb
end trace frame: 0x0, count: -5
ddb{5}> trace /t 0t131775
end trace frame: 0x0, count: -1
ddb{5}> trace /t 0t266671
end trace frame: 0x0, count: -1
ddb{5}> trace /t 0t367167
end trace frame: 0x0, count: -1
ddb{5}> trace /t 0t519412
end trace frame: 0x0, count: -1
ddb{5}>
ddb{5}> show uvm
Current UVM status:
pagesize=4096 (0x1000), pagemask=0xfff, pageshift=12
97256743 VM pages: 230 active, 178506 inactive, 1 wired, 96541684 free (12140
350 zero)
min 10% (25) anon, 10% (25) vnode, 5% (12) vtext
freemin=3241891, free-target=4322521, inactive-target=4322522, wired-max=3241
8914
faults=865281, traps=837079, intrs=570664292, ctxswitch=30019348 fpuswitch=0
softint=335484, syscalls=506296, kmapent=9
fault counts:
noram=0, noanon=0, noamap=0, pgwait=0, pgrele=0
ok relocks(total)=205599(233146), anget(retries)=310975(0), amapcopy=34140
neighbor anon/obj pg=557255/672956, gets(lock/unlock)=420459/233190
cases: anon=297559, anoncow=13416, obj=380646, prcopy=12221, przero=160416
daemon and swap counts:
woke=102598, revs=210809, scans=0, obscans=0, anscans=0
busy=0, freed=0, reactivate=0, deactivate=1348046
pageouts=0, pending=0, nswget=0
nswapdev=1
swpages=19267986, swpginuse=0, swpgonly=0 paging=0
kernel pointers:
objs(kern)=0xffffffff8258e2f0
ddb{5}> show mbuf
mbuf 0xffffffff8104d624
m_type: 4083 m_flags: fa1e<M_PKTHDR,M_EOR,M_EXTWR,M_PROTO1,M_MCAST,M_AUTH,M_
TUNNEL,M_ZEROIZE,M_COMP,M_LINK0>
m_next: 0x1d3b4c241c334c5d m_nextpkt: 0xcccc0d74014cbe10
m_data: 0xcccccccccccccccc m_len: 3284978892
m_dat: 0xffffffff8104d644 m_pktdat: 0xffffffff8104d694
m_ptkhdr.ph_ifidx: 1090028360 m_pkthdr.len: -858993460
m_ptkhdr.ph_tags: 0x31e5894855241c33 m_pkthdr.ph_tagsset: 3074<IPSEC_FLOWINF
O,IPSEC_PENDING_TDB,BRIDGE,WG,SRCROUTE,TUNNEL>
m_pkthdr.ph_flowid: 35656 m_pkthdr.ph_loopcnt: 72
m_pkthdr.csum_flags: c50c<UDP_CSUM_OUT,IPV4_CSUM_IN_OK,UDP_CSUM_IN_BAD,ICMP_CSU
M_IN_OK,FLOWID,TCP_TSO>
m_pkthdr.ether_vtag: 28736 m_ptkhdr.ph_rtableid: 46170952
m_pkthdr.pf.statekey: 0x85081c70a74c9 m_pkthdr.pf.inp 0xc8b480000000000
m_pkthdr.pf.qid: 1483753669 m_pkthdr.pf.tag: 18562
m_pkthdr.pf.flags: 74<TRANSLATE_LOCALHOST,DIVERTED_PACKET,REROUTE,REFRAGMENTED>
m_pkthdr.pf.routed: 210 m_pkthdr.pf.prio: 199
ddb{5}> show all pool
Name Size Requests Fail Releases Pgreq Pgrel Npage Hiwat Minpg Maxpg Idle
plcache 128 384 0 0 13 0 13 13 0 8 0
rtpcb 120 30 0 30 1 1 0 1 0 8 0
rtentry 112 126 0 0 4 0 4 4 0 8 0
unpcb 144 88 0 44 2 0 2 2 0 8 0
tcpqe 32 2 0 2 2 2 0 1 0 8 0
tcpcb 808 23 0 17 1 0 1 1 0 8 0
arp 88 18 0 0 1 0 1 1 0 8 0
inpcb 352 684 0 676 2 1 1 2 0 8 0
nd6 104 24 0 0 1 0 1 1 0 8 0
art_heap8 4096 1 0 0 1 0 1 1 0 8 0
art_heap4 256 503 0 0 32 0 32 32 0 8 0
art_table 32 504 0 0 5 0 5 5 0 8 0
art_node 16 126 0 0 1 0 1 1 0 8 0
dirhash 1024 83 0 36 6 0 6 6 0 8 0
dino2pl 256 5701 0 1732 260 11 249 249 0 8 0
ffsino 240 5701 0 1732 245 11 234 234 0 8 0
nchpl 144 6069 0 2810 126 5 121 121 0 8 0
uvmvnodes 80 5722 0 0 117 0 117 117 0 8 0
vnodes 216 5722 0 0 318 0 318 318 0 8 0
namei 1024 18836 0 18836 111 110 1 2 0 8 1
percpumem 256 38 0 0 3 0 3 3 0 8 0
kstatmem 264 320 0 0 22 0 22 22 0 8 0
xhcixfer 280 168 0 160 1 0 1 1 0 8 0
scxspl 216 59255 0 59255 5 4 1 4 1 8 1
plimitpl 152 38 0 21 1 0 1 1 0 8 0
sigapl 424 577 0 492 11 0 11 11 0 8 0
futexpl 64 7078 0 7078 1 1 0 1 0 8 0
knotepl 120 162 0 0 5 0 5 5 0 8 0
kqueuepl 184 28 0 8 4 3 1 2 0 8 0
pipepl 288 165 0 165 3 3 0 1 0 8 0
fdescpl 432 514 0 492 4 0 4 4 0 8 0
filepl 120 9199 0 9113 5 2 3 4 0 8 0
lockfpl 104 2 0 2 1 1 0 1 0 8 0
lockfspl 48 1 0 1 1 1 0 1 0 8 0
sessionpl 144 17 0 3 1 0 1 1 0 8 0
pgrppl 48 37 0 23 1 0 1 1 0 8 0
ucredpl 104 106 0 89 1 0 1 1 0 8 0
zombiepl 144 492 0 492 12 12 0 1 0 8 0
processpl 1080 577 0 492 7 0 7 7 0 8 0
procpl 656 812 0 727 11 3 8 11 0 8 0
sockpl 504 802 0 750 11 3 8 8 0 8 0
mcl12k 12288 75760 9828264 0 7577 1 7576 7576 0 8 0
mcl9k 9216 17 0 0 2 0 2 2 0 8 0
mcl8k 8192 512 0 0 64 0 64 64 0 8 0
mcl2k2 2112 859 0 0 55 2 53 53 0 8 0
mcl2k 2048 1193 0 0 100 2 98 98 0 8 0
mtagpl 96 166 0 0 3 0 3 3 0 8 0
mbufpl 256 191088 0 0 6675 40 6635 6638 0 8 0
bufpl 280 70302 0 12507 4131 2 4129 4129 0 8 0
anonpl 24 186053 0 181502 361 322 39 355 0 36617 0
amapchunkpl 152 16489 0 16132 160 141 19 155 0 158 0
amappl16 200 1598 0 1594 39 38 1 32 0 8 0
amappl15 192 6 0 6 1 1 0 1 0 8 0
amappl14 184 236 0 217 2 0 2 2 0 8 0
amappl13 176 23 0 23 1 1 0 1 0 8 0
amappl12 168 1431 0 1409 5 3 2 5 0 8 0
amappl11 160 157 0 131 2 0 2 2 0 8 0
amappl10 152 36 0 35 1 0 1 1 0 8 0
amappl9 144 45 0 45 2 2 0 1 0 8 0
amappl8 136 1078 0 1067 32 31 1 32 0 8 0
amappl7 128 72 0 71 2 1 1 1 0 8 0
amappl6 120 533 0 513 3 1 2 3 0 8 0
amappl5 112 339 0 311 7 6 1 4 0 8 0
amappl4 104 2675 0 2614 43 40 3 42 0 8 0
amappl3 96 2218 0 2164 9 6 3 9 0 8 0
amappl2 88 6386 0 6237 98 93 5 97 0 8 0
amappl1 80 9320 0 8649 20 2 18 18 0 8 0
amappl 88 4931 0 4796 30 24 6 30 0 92 0
dma4096 4096 9 0 3 1 0 1 1 0 8 0
dma2048 2048 1 0 1 1 1 0 1 0 8 0
dma512 512 14 0 14 1 1 0 1 0 8 0
dma256 256 16 0 16 1 1 0 1 0 8 0
dma128 128 3 0 3 1 1 0 1 0 8 0
dma64 64 9 0 9 1 1 0 1 0 8 0
dma32 32 13 0 13 1 1 0 1 0 8 0
dma16 16 23 0 23 1 1 0 1 0 8 0
aobjpl 72 2 0 0 1 0 1 1 0 8 0
uaddrrnd 24 514 0 492 1 0 1 1 0 8 0
uaddrbest 32 2 0 0 1 0 1 1 0 8 0
uaddr 24 514 0 492 1 0 1 1 0 8 0
vmmpekpl 168 18424 0 18406 2 0 2 2 0 8 0
vmmpepl 168 66268 0 64441 579 487 92 554 0 357 0
vmsppl 344 513 0 492 3 0 3 3 0 8 0
rwobjpl 24 32153 0 25244 92 46 46 92 0 8 0
pdppl 4096 1039 0 984 121 66 55 77 0 8 0
pvpl 32 295525 0 67857 1839 2 1837 1837 0 265 0
pmappl 216 514 0 492 2 0 2 2 0 8 0
extentpl 40 292 0 158 2 0 2 2 0 8 0
phpool 112 7637 0 249 236 24 212 212 0 8 0
ddb{5}>
ddb{5}> mach ddbcpu 0
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffffffff82585ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
mtx_enter(ffffffff8260a150) at mtx_enter+0x3b
uvm_pmr_getpages(20,0,100000,20,0,1,6537b28342a8fe54,100000) at uvm_pmr_getpage
s+0x23c
uvm_pglistalloc(20000,0,ffffffff,20000,0,ffff80005c1da838,a1b13745cb11ab83,2000
0) at uvm_pglistalloc+0x126
km_alloc(20000,ffff80005c1da8b8,ffffffff8227fc58,ffff80005c1da8d0) at km_alloc+
0x27f
pool_multi_alloc(ffffffff8260d168,2,ffff80005c1daaa4) at pool_multi_alloc+0xae
m_pool_alloc(ffffffff8260d168,2,ffff80005c1daaa4) at m_pool_alloc+0x4b
pool_p_alloc(ffffffff8260d168,2,ffff80005c1daaa4) at pool_p_alloc+0x5f
pool_do_get(ffffffff8260d168,2,ffff80005c1daaa4) at pool_do_get+0xd3
pool_get(ffffffff8260d168,2) at pool_get+0x97
m_clget(0,2,2520) at m_clget+0x1b4
mcx_rx_fill(ffff80000190a000,ffff80000192a1c0) at mcx_rx_fill+0xa6
end trace frame: 0xffff80005c1dabf0, count: 0
ddb{0}> mach ddbcpu 1
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff80005533bff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
__mp_release_all(ffffffff8263d110) at __mp_release_all+0x38
msleep(ffff800000037000,ffff800000037018,20,ffffffff8220b73d,0) at msleep+0xee
taskq_next_work(ffff800000037000,ffff80005c1f8930) at taskq_next_work+0x61
taskq_thread(ffff800000037000) at taskq_thread+0xeb
end trace frame: 0x0, count: 8
ddb{1}> mach ddbcpu 2
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff800055344ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
__mp_release_all(ffffffff8263d110) at __mp_release_all+0x38
msleep(ffff800000037300,ffff800000037318,20,ffffffff8220b73d,0) at msleep+0xee
taskq_next_work(ffff800000037300,ffff80005c21cba0) at taskq_next_work+0x61
taskq_thread(ffff800000037300) at taskq_thread+0xeb
end trace frame: 0x0, count: 8
ddb{2}> mach ddbcpu 3
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff80005534dff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
__mp_release_all(ffffffff8263d110) at __mp_release_all+0x38
msleep(fffffdd81c64fac8,fffffdd81c64fac8,318,ffffffff821bbaf5,61) at msleep+0xe
e
kqueue_sleep(fffffdd81c64fac8,ffff80005c3bc688) at kqueue_sleep+0xbf
kqueue_scan(ffff80005c3bc480,4,ffff80005c3bc380,ffff80005c3bc688,ffff8000fffdfc
60,ffff80005c3bc60c) at kqueue_scan+0x108
doppoll(ffff8000fffdfc60,10485e542a0,4,ffff80005c3bc688,0,ffff80005c3bc6f0) at d
oppoll+0x264
sys_poll(ffff8000fffdfc60,ffff80005c3bc780,ffff80005c3bc6f0) at sys_poll+0x6e
syscall(ffff80005c3bc780) at syscall+0x588
Xsyscall() at Xsyscall+0x128
end of kernel
end trace frame: 0x74ad33c9b1b0, count: 4
ddb{3}> mach ddbcpu 4
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff800055356ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
mtx_leave(ffff800000037798) at mtx_leave+0x15
msleep(ffff800000037780,ffff800000037798,20,ffffffff8220b73d,0) at msleep+0xd9
taskq_next_work(ffff800000037780,ffff80005c252700) at taskq_next_work+0x61
taskq_thread(ffff800000037780) at taskq_thread+0xeb
end trace frame: 0x0, count: 8
ddb{4}> mach ddbcpu 5
Stopped at db_enter+0x14: popq %rbp
db_enter() at db_enter+0x14
panic(ffffffff82210143) at panic+0xc3
__assert(ffffffff821c869c,ffffffff8221a660,3b9,ffffffff821e89b6) at __assert+0x
29
uvn_get(fffffdd9e5a41940,d7000,ffff80005c3aa1d0,ffff80005c3aa06c,3,4,226f342e33
64f4c8,ffff80005c3aa288) at uvn_get+0x2d4
uvm_fault_lower_lookup(ffff80005c3aa250,ffff80005c3aa288,ffff80005c3aa1d0) at u
vm_fault_lower_lookup+0xcb
uvm_fault_lower(ffff80005c3aa250,ffff80005c3aa288,ffff80005c3aa1d0,0) at uvm_fa
ult_lower+0x4b
uvm_fault(fffffd83e6262d70,e53cae25000,0,4) at uvm_fault+0x1b1
upageflttrap(ffff80005c3aa3b0,e53cae25c7b) at upageflttrap+0x6c
usertrap(ffff80005c3aa3b0) at usertrap+0x1eb
recall_trap() at recall_trap+0x8
end of kernel
end trace frame: 0x7ee189e1ed70, count: 5
ddb{5}> mach ddbcpu 6
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff800055368ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
__mp_release_all(ffffffff8263d110) at __mp_release_all+0x38
msleep(ffff800000037700,ffff800000037718,20,ffffffff8220b73d,0) at msleep+0xee
taskq_next_work(ffff800000037700,ffff80005c24c870) at taskq_next_work+0x61
taskq_thread(ffff800000037700) at taskq_thread+0xeb
end trace frame: 0x0, count: 8
ddb{6}> mach ddbcpu 7
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff800055371ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
__mp_release_all(ffffffff8263d110) at __mp_release_all+0x38
msleep(ffff800000037200,ffff800000037218,20,ffffffff8220b73d,0) at msleep+0xee
taskq_next_work(ffff800000037200,ffff80005c20fee0) at taskq_next_work+0x61
taskq_thread(ffff800000037200) at taskq_thread+0xeb
end trace frame: 0x0, count: 8
ddb{7}> mach ddbcpu 8
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff80005537aff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
acpicpu_idle() at acpicpu_idle+0x203
sched_idle(ffff80005537aff0) at sched_idle+0x23d
end trace frame: 0x0, count: 10
ddb{8}> mach ddbcpu 9
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff800055383ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
msleep_nsec(ffff800000037400,ffff800000037418,20,ffffffff8220b73d,fffffffffffff
fff) at msleep_nsec+0xc4
taskq_next_work(ffff800000037400,ffff80005c2284e0) at taskq_next_work+0x61
taskq_thread(ffff800000037400) at taskq_thread+0xeb
end trace frame: 0x0, count: 9
ddb{9}> mach ddbcpu 0xa
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff80005538cff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
mtx_enter(ffff800000037618) at mtx_enter+0x28
msleep(ffff800000037600,ffff800000037618,20,ffffffff8220b73d,0) at msleep+0x10d
taskq_next_work(ffff800000037600,ffff80005c2403d0) at taskq_next_work+0x61
taskq_thread(ffff800000037600) at taskq_thread+0xeb
end trace frame: 0x0, count: 8
ddb{10}> mach ddbcpu 0xb
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff800055395ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
ether_input(ffff80000190a048,fffffd80497ddf00) at ether_input+0x3c
if_input_process(ffff80000190a048,ffff80005c2343d8) at if_input_process+0x6f
ifiq_process(ffff80000193aa00) at ifiq_process+0x75
taskq_thread(ffff800000037500) at taskq_thread+0x100
end trace frame: 0x0, count: 8
ddb{11}> mach ddbcpu 0xc
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff80005539eff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
__mp_acquire_count(ffffffff8263d110,1) at __mp_acquire_count+0x86
msleep(ffffffff8260a190,ffffffff8260a150,4,ffffffff821e75e3,0) at msleep+0xfc
uvm_pageout(ffff8000fffe7210) at uvm_pageout+0x117
end trace frame: 0x0, count: 9
ddb{12}> mach ddbcpu 0xd
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff8000553a7ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
__mp_release_all(ffffffff8263d110) at __mp_release_all+0x38
msleep(ffff800000037380,ffff800000037398,20,ffffffff8220b73d,0) at msleep+0xee
taskq_next_work(ffff800000037380,ffff80005c222630) at taskq_next_work+0x61
taskq_thread(ffff800000037380) at taskq_thread+0xeb
end trace frame: 0x0, count: 8
ddb{13}> mach ddbcpu 0xe
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff8000553b0ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
mtx_enter(ffff800000037698) at mtx_enter+0x28
msleep(ffff800000037680,ffff800000037698,20,ffffffff8220b73d,0) at msleep+0x10d
taskq_next_work(ffff800000037680,ffff80005c2462b0) at taskq_next_work+0x61
taskq_thread(ffff800000037680) at taskq_thread+0xeb
end trace frame: 0x0, count: 8
ddb{14}> mach ddbcpu 0xf
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff8000553b9ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
acpicpu_idle() at acpicpu_idle+0x203
sched_idle(ffff8000553b9ff0) at sched_idle+0x23d
end trace frame: 0x0, count: 10
ddb{15}> mach ddbcpu 0x10
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff8000553c2ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
acpicpu_idle() at acpicpu_idle+0x203
sched_idle(ffff8000553c2ff0) at sched_idle+0x23d
end trace frame: 0x0, count: 10
ddb{16}> mach ddbcpu 0x11
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff8000553cbff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
acpicpu_idle() at acpicpu_idle+0x203
sched_idle(ffff8000553cbff0) at sched_idle+0x23d
end trace frame: 0x0, count: 10
ddb{17}> mach ddbcpu 0x12
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff8000553d4ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
acpicpu_idle() at acpicpu_idle+0x203
sched_idle(ffff8000553d4ff0) at sched_idle+0x23d
end trace frame: 0x0, count: 10
ddb{18}> mach ddbcpu 0x13
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff8000553ddff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
acpicpu_idle() at acpicpu_idle+0x203
sched_idle(ffff8000553ddff0) at sched_idle+0x23d
end trace frame: 0x0, count: 10
ddb{19}> mach ddbcpu 0x14
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff8000553e6ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
acpicpu_idle() at acpicpu_idle+0x203
sched_idle(ffff8000553e6ff0) at sched_idle+0x23d
end trace frame: 0x0, count: 10
ddb{20}> mach ddbcpu 0x15
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff8000553efff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
acpicpu_idle() at acpicpu_idle+0x203
sched_idle(ffff8000553efff0) at sched_idle+0x23d
end trace frame: 0x0, count: 10
ddb{21}> mach ddbcpu 0x16
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff8000553f8ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
spllower(4) at spllower+0x4f
m_clget(0,2,2520) at m_clget+0x121
mcx_rx_fill(ffff80000190a000,ffff80000192a940) at mcx_rx_fill+0xa6
mcx_cq_intr(ffff80000192a900) at mcx_cq_intr+0x3fb
intr_handler(ffff80005c2dcd20,ffff80000192f200) at intr_handler+0x8f
Xintr_ioapic_edge0_untramp() at Xintr_ioapic_edge0_untramp+0x18f
acpicpu_idle() at acpicpu_idle+0x203
sched_idle(ffff8000553f8ff0) at sched_idle+0x23d
end trace frame: 0x0, count: 4
ddb{22}> mach ddbcpu 0x17
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff800055401ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
acpicpu_idle() at acpicpu_idle+0x203
sched_idle(ffff800055401ff0) at sched_idle+0x23d
end trace frame: 0x0, count: 10
ddb{23}> mach ddbcpu 0x18
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff80005540aff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
x86_bus_space_io_read_1(3f8,5) at x86_bus_space_io_read_1+0x19
comcnputc(800,20) at comcnputc+0x12f
cnputc(20) at cnputc+0x3b
db_putchar(74) at db_putchar+0x29a
kprintf() at kprintf+0x40b
db_printf(ffffffff821e2291) at db_printf+0x6d
db_ktrap(6,2,ffff80005c258830) at db_ktrap+0x1bf
kerntrap(ffff80005c258830) at kerntrap+0xa7
alltraps_kern_meltdown() at alltraps_kern_meltdown+0x7b
mcx_cq_intr(ffff80000192a400) at mcx_cq_intr+0x2e9
intr_handler(ffff80005c2589f0,ffff800001938080) at intr_handler+0x8f
end trace frame: 0xffff80005c258a70, count: 0
ddb{24}> mach ddbcpu 0x19
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff800055413ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
acpicpu_idle() at acpicpu_idle+0x203
sched_idle(ffff800055413ff0) at sched_idle+0x23d
end trace frame: 0x0, count: 10
ddb{25}> mach ddbcpu 0x1a
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff80005541cff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
x86_bus_space_mem_read_4(ffff800055333000,f0) at x86_bus_space_mem_read_4+0x18
acpihpet_delay(1) at acpihpet_delay+0x42
comcnputc(800,20) at comcnputc+0x99
cnputc(20) at cnputc+0x3b
db_putchar(74) at db_putchar+0x29a
kprintf() at kprintf+0x40b
db_printf(ffffffff821e2291) at db_printf+0x6d
db_ktrap(6,0,ffff80005c2f3720) at db_ktrap+0x1bf
kerntrap(ffff80005c2f3720) at kerntrap+0xa7
alltraps_kern_meltdown() at alltraps_kern_meltdown+0x7b
_rb_insert(ffffffff8224deb0,fffffd8100014008,fffffd83e5827780) at _rb_insert+0x
264
end trace frame: 0xffff80005c2f38b0, count: 0
ddb{26}> mach ddbcpu 0x1b
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff800055425ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
acpicpu_idle() at acpicpu_idle+0x203
sched_idle(ffff800055425ff0) at sched_idle+0x23d
end trace frame: 0x0, count: 10
ddb{27}> mach ddbcpu 0x1c
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff80005542eff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
_rb_insert(ffffffff8224deb0,fffffd8100014008,fffffd83e597ee00) at _rb_insert+0x
6d
uvm_pmr_extract_range(fffffd8100014000,fffffd83e597ed80,5ba00,5ba03,ffff80005c2
ffa88) at uvm_pmr_extract_range+0x1d0
uvm_pmr_getpages(20,0,100000,20,0,1,6537b28342a8fe54,100000) at uvm_pmr_getpage
s+0x781
uvm_pglistalloc(20000,0,ffffffff,20000,0,ffff80005c2ffa88,a1b13745cb11ab83,2000
0) at uvm_pglistalloc+0x126
km_alloc(20000,ffff80005c2ffb08,ffffffff8227fc58,ffff80005c2ffb20) at km_alloc+
0x27f
pool_multi_alloc(ffffffff8260d168,2,ffff80005c2ffcf4) at pool_multi_alloc+0xae
m_pool_alloc(ffffffff8260d168,2,ffff80005c2ffcf4) at m_pool_alloc+0x4b
pool_p_alloc(ffffffff8260d168,2,ffff80005c2ffcf4) at pool_p_alloc+0x5f
pool_do_get(ffffffff8260d168,2,ffff80005c2ffcf4) at pool_do_get+0xd3
pool_get(ffffffff8260d168,2) at pool_get+0x97
m_clget(0,2,2520) at m_clget+0x1b4
end trace frame: 0xffff80005c2ffe10, count: 0
ddb{28}> mach ddbcpu 0x1d
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff800055437ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
acpicpu_idle() at acpicpu_idle+0x203
sched_idle(ffff800055437ff0) at sched_idle+0x23d
end trace frame: 0x0, count: 10
ddb{29}> mach ddbcpu 0x1e
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff800055440ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
acpicpu_idle() at acpicpu_idle+0x203
sched_idle(ffff800055440ff0) at sched_idle+0x23d
end trace frame: 0x0, count: 10
ddb{30}> mach ddbcpu 0x1f
Stopped at x86_ipi_db+0x16: leave
x86_ipi_db(ffff800055449ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
acpicpu_idle() at acpicpu_idle+0x203
sched_idle(ffff800055449ff0) at sched_idle+0x23d
end trace frame: 0x0, count: 10
ddb{31}>