Hi,
This is the 2nd panic I get on this machine after 7.4, both the same,
ip_output() from pflow_output_process()
ddb{0}> show panic
*cpu0: ip_output no HDR
ddb{0}> trace
db_enter() at db_enter+0x14
panic(ffffffff820bea35) at panic+0xc3
ip_output(fffffd80b320ad00,0,fffffd8120670c48,0,0,fffffd8120670bd0,5718952b04ba
576d) at ip_output+0xa26
udp_output(fffffd8120670bd0,fffffd80b320ad00,fffffd80bd64a600,0) at udp_output+
0x3be
sosend(fffffd8120671720,fffffd80bd64a600,0,fffffd80b320ad00,0,0) at sosend+0x37
f
pflow_output_process(ffff800000875000) at pflow_output_process+0x67
taskq_thread(ffff80000002e380) at taskq_thread+0x100
end trace frame: 0x0, count: -7
I couldn't continue the debug because "machine ddbcpu 1" completely hanged the
machine.
It's strange because it's a backup router (bgpd/ospfd) and didn't have any
traffic at that moment.
Nothing on the logs at the time of panic.
On the last panic I managed to do a ps and got the * at softnet proc 3 if I
remember correct.
# ifconfig pflow
pflow0: flags=41<UP,RUNNING> mtu 1448
index 11 priority 0 llprio 3
pflow: sender: xx.xx.xx.xx receiver: yy.yy.yy.yy:zzzz version: 10
groups: pflow
OpenBSD 7.4 (GENERIC.MP) #0: Sun Oct 22 12:13:42 MDT 2023
r...@syspatch-74-amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 4234805248 (4038MB)
avail mem = 4086726656 (3897MB)
random: good seed from bootblocks
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.5 @ 0xbf6c8000 (92 entries)
bios0: vendor FUJITSU // Phoenix Technologies Ltd. version "6.00 Rev.
1.06.3031" date 12/14/2010
bios0: FUJITSU PRIMERGY RX200 S6
acpi0 at bios0: ACPI 3.0
acpi0: sleep states S0 S1 S4 S5
acpi0: tables DSDT FACP TCPA SLIT SSDT SSDT SSDT SSDT SSDT SSDT SSDT SSDT SSDT
SSDT SSDT SSDT EINJ HEST BERT SSDT ERST SPCR MCFG HPET APIC BOOT
acpi0: wakeup devices PE0_(S4) PE1_(S4) PE3_(S4) PE7_(S4) PE9_(S4) PE1A(S4)
USB1(S1) USB2(S1) USB3(S1) USB4(S1) USB5(S1) USB6(S1) USB7(S1) USB8(S1) COM1(S1)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimcfg0 at acpi0
acpimcfg0: addr 0xe0000000, bus 0-6
acpihpet0 at acpi0: 14318179 Hz
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 32 (boot processor)
cpu0: Intel(R) Xeon(R) CPU X5660 @ 2.80GHz, 2800.13 MHz, 06-2c-02, patch
0000001f
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,MELTDOWN
cpu0: 32KB 64b/line 8-way D-cache, 32KB 64b/line 4-way I-cache, 256KB 64b/line
8-way L2 cache, 12MB 64b/line 16-way L3 cache
cpu0: smt 0, core 0, package 1
mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
cpu0: apic clock running at 133MHz
cpu0: mwait min=64, max=64, C-substates=0.2.1.1, IBE
cpu1 at mainbus0: apid 34 (application processor)
cpu1: Intel(R) Xeon(R) CPU X5660 @ 2.80GHz, 2800.14 MHz, 06-2c-02, patch
0000001f
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,MELTDOWN
cpu1: 32KB 64b/line 8-way D-cache, 32KB 64b/line 4-way I-cache, 256KB 64b/line
8-way L2 cache, 12MB 64b/line 16-way L3 cache
cpu1: smt 0, core 1, package 1
cpu2 at mainbus0: apid 36 (application processor)
cpu2: Intel(R) Xeon(R) CPU X5660 @ 2.80GHz, 2800.18 MHz, 06-2c-02, patch
0000001f
cpu2:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,MELTDOWN
cpu2: 32KB 64b/line 8-way D-cache, 32KB 64b/line 4-way I-cache, 256KB 64b/line
8-way L2 cache, 12MB 64b/line 16-way L3 cache
cpu2: smt 0, core 2, package 1
cpu3 at mainbus0: apid 48 (application processor)
cpu3: Intel(R) Xeon(R) CPU X5660 @ 2.80GHz, 2800.22 MHz, 06-2c-02, patch
0000001f
cpu3:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,MELTDOWN
cpu3: 32KB 64b/line 8-way D-cache, 32KB 64b/line 4-way I-cache, 256KB 64b/line
8-way L2 cache, 12MB 64b/line 16-way L3 cache
cpu3: smt 0, core 8, package 1
cpu4 at mainbus0: apid 50 (application processor)
cpu4: Intel(R) Xeon(R) CPU X5660 @ 2.80GHz, 2800.19 MHz, 06-2c-02, patch
0000001f
cpu4:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,MELTDOWN
cpu4: 32KB 64b/line 8-way D-cache, 32KB 64b/line 4-way I-cache, 256KB 64b/line
8-way L2 cache, 12MB 64b/line 16-way L3 cache
cpu4: smt 0, core 9, package 1
cpu5 at mainbus0: apid 52 (application processor)
cpu5: Intel(R) Xeon(R) CPU X5660 @ 2.80GHz, 2800.25 MHz, 06-2c-02, patch
0000001f
cpu5:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,MELTDOWN
cpu5: 32KB 64b/line 8-way D-cache, 32KB 64b/line 4-way I-cache, 256KB 64b/line
8-way L2 cache, 12MB 64b/line 16-way L3 cache
cpu5: smt 0, core 10, package 1
ioapic0 at mainbus0: apid 0 pa 0xfec00000, version 20, 24 pins
ioapic1 at mainbus0: apid 1 pa 0xfec80000, version 20, 24 pins
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 1 (PE1_)
acpiprt2 at acpi0: bus 2 (PE3_)
acpiprt3 at acpi0: bus 3 (PE7_)
acpiprt4 at acpi0: bus 4 (PE9_)
acpiprt5 at acpi0: bus 5 (PE1A)
acpibtn0 at acpi0: PWRB
acpipci0 at acpi0 CPU0
acpipci1 at acpi0 CPU1
acpipci2 at acpi0 PCI0
acpicmos0 at acpi0
"PNP0A05" at acpi0 not configured
com0 at acpi0 COM1 addr 0x3f8/0x8 irq 4: ns16550a, 16 byte fifo
com0: console
ipmi0 at acpi0: version 2.0 interface KCS iobase 0xca2/2 spacing 1
"PNP0A05" at acpi0 not configured
acpiac0 at acpi0: AC unit online
"ACPI000D" at acpi0 not configured
acpicpu0 at acpi0: C3(350@128 io@0x1015), C2(500@96 io@0x1014), C1(1000@32
halt), PSS
acpicpu1 at acpi0: C3(350@128 io@0x1015), C2(500@96 io@0x1014), C1(1000@32
halt), PSS
acpicpu2 at acpi0: C3(350@128 io@0x1015), C2(500@96 io@0x1014), C1(1000@32
halt), PSS
acpicpu3 at acpi0: C3(350@128 io@0x1015), C2(500@96 io@0x1014), C1(1000@32
halt), PSS
acpicpu4 at acpi0: C3(350@128 io@0x1015), C2(500@96 io@0x1014), C1(1000@32
halt), PSS
acpicpu5 at acpi0: C3(350@128 io@0x1015), C2(500@96 io@0x1014), C1(1000@32
halt), PSS
ipmi at mainbus0 not configured
cpu0: using IvyBridge MDS workaround
cpu0: Enhanced SpeedStep 2800 MHz: speeds: 2794, 2793, 2660, 2527, 2394, 2261,
2128, 1995, 1862, 1729, 1596 MHz
pci0 at mainbus0 bus 255
pci1 at mainbus0 bus 254
pchb0 at pci1 dev 0 function 0 vendor "Intel", unknown product 0x2c70 rev 0x02
pchb1 at pci1 dev 0 function 1 vendor "Intel", unknown product 0x2d81 rev 0x02
pchb2 at pci1 dev 2 function 0 vendor "Intel", unknown product 0x2d90 rev 0x02
pchb3 at pci1 dev 2 function 1 vendor "Intel", unknown product 0x2d91 rev 0x02
pchb4 at pci1 dev 2 function 2 vendor "Intel", unknown product 0x2d92 rev 0x02
pchb5 at pci1 dev 2 function 3 vendor "Intel", unknown product 0x2d93 rev 0x02
pchb6 at pci1 dev 2 function 4 vendor "Intel", unknown product 0x2d94 rev 0x02
pchb7 at pci1 dev 2 function 5 vendor "Intel", unknown product 0x2d95 rev 0x02
pchb8 at pci1 dev 3 function 0 vendor "Intel", unknown product 0x2d98 rev 0x02
pchb9 at pci1 dev 3 function 1 vendor "Intel", unknown product 0x2d99 rev 0x02
pchb10 at pci1 dev 3 function 2 vendor "Intel", unknown product 0x2d9a rev 0x02
pchb11 at pci1 dev 3 function 4 vendor "Intel", unknown product 0x2d9c rev 0x02
pchb12 at pci1 dev 4 function 0 vendor "Intel", unknown product 0x2da0 rev 0x02
pchb13 at pci1 dev 4 function 1 vendor "Intel", unknown product 0x2da1 rev 0x02
pchb14 at pci1 dev 4 function 2 vendor "Intel", unknown product 0x2da2 rev 0x02
pchb15 at pci1 dev 4 function 3 vendor "Intel", unknown product 0x2da3 rev 0x02
pchb16 at pci1 dev 5 function 0 vendor "Intel", unknown product 0x2da8 rev 0x02
pchb17 at pci1 dev 5 function 1 vendor "Intel", unknown product 0x2da9 rev 0x02
pchb18 at pci1 dev 5 function 2 vendor "Intel", unknown product 0x2daa rev 0x02
pchb19 at pci1 dev 5 function 3 vendor "Intel", unknown product 0x2dab rev 0x02
pchb20 at pci1 dev 6 function 0 vendor "Intel", unknown product 0x2db0 rev 0x02
pchb21 at pci1 dev 6 function 1 vendor "Intel", unknown product 0x2db1 rev 0x02
pchb22 at pci1 dev 6 function 2 vendor "Intel", unknown product 0x2db2 rev 0x02
pchb23 at pci1 dev 6 function 3 vendor "Intel", unknown product 0x2db3 rev 0x02
pci2 at mainbus0 bus 0
pchb24 at pci2 dev 0 function 0 "Intel 5500 Host" rev 0x13
ppb0 at pci2 dev 1 function 0 "Intel X58 PCIE" rev 0x13: msi
pci3 at ppb0 bus 1
em0 at pci3 dev 0 function 0 "Intel 82575EB" rev 0x02: msi, address
00:26:2d:08:ec:90
em1 at pci3 dev 0 function 1 "Intel 82575EB" rev 0x02: msi, address
00:26:2d:08:ec:91
ppb1 at pci2 dev 3 function 0 "Intel X58 PCIE" rev 0x13: msi
pci4 at ppb1 bus 2
mfi0 at pci4 dev 0 function 0 "Symbios Logic MegaRAID SAS2008" rev 0x03: apic 1
int 0
mfi0: "RAID Ctrl SAS 6G 0/1 (D2607)", firmware 20.7.1-0025
scsibus1 at mfi0: 16 targets
sd0 at scsibus1 targ 0 lun 0: <LSI, RAID SAS 6G 0/1, 2.90>
naa.6003005700e52e90220725cb12d5fef2
sd0: 69472MB, 512 bytes/sector, 142278656 sectors
scsibus2 at mfi0: 256 targets
ppb2 at pci2 dev 7 function 0 "Intel X58 PCIE" rev 0x13: msi
pci5 at ppb2 bus 3
ixl0 at pci5 dev 0 function 0 "Intel X710 SFP+" rev 0x02: port 1, FW 6.0.48442
API 1.7, msix, 4 queues, address 00:00:00:00:01:00
ixl1 at pci5 dev 0 function 1 "Intel X710 SFP+" rev 0x02: port 0, FW 6.0.48442
API 1.7, msix, 4 queues, address 00:00:00:00:01:01
ppb3 at pci2 dev 9 function 0 "Intel X58 PCIE" rev 0x13: msi
pci6 at ppb3 bus 4
ix0 at pci6 dev 0 function 0 "Intel 82599" rev 0x01, msix, 6 queues, address
90:e2:ba:77:e9:e8
ix1 at pci6 dev 0 function 1 "Intel 82599" rev 0x01, msix, 6 queues, address
90:e2:ba:77:e9:e9
"Intel X58 QuickPath" rev 0x13 at pci2 dev 16 function 0 not configured
"Intel X58 QuickPath" rev 0x13 at pci2 dev 16 function 1 not configured
"Intel X58 QuickPath" rev 0x13 at pci2 dev 17 function 0 not configured
"Intel X58 QuickPath" rev 0x13 at pci2 dev 17 function 1 not configured
"Intel X58 Misc" rev 0x13 at pci2 dev 20 function 0 not configured
"Intel X58 GPIO" rev 0x13 at pci2 dev 20 function 1 not configured
"Intel X58 RAS" rev 0x13 at pci2 dev 20 function 2 not configured
"Intel X58 Throttle" rev 0x13 at pci2 dev 20 function 3 not configured
vendor "Intel", unknown product 0x342f (class system subclass interrupt, rev
0x13) at pci2 dev 21 function 0 not configured
"Intel X58 QuickData" rev 0x13 at pci2 dev 22 function 0 not configured
"Intel X58 QuickData" rev 0x13 at pci2 dev 22 function 1 not configured
"Intel X58 QuickData" rev 0x13 at pci2 dev 22 function 2 not configured
"Intel X58 QuickData" rev 0x13 at pci2 dev 22 function 3 not configured
"Intel X58 QuickData" rev 0x13 at pci2 dev 22 function 4 not configured
"Intel X58 QuickData" rev 0x13 at pci2 dev 22 function 5 not configured
"Intel X58 QuickData" rev 0x13 at pci2 dev 22 function 6 not configured
"Intel X58 QuickData" rev 0x13 at pci2 dev 22 function 7 not configured
uhci0 at pci2 dev 26 function 0 "Intel 82801JI USB" rev 0x00: apic 0 int 19
uhci1 at pci2 dev 26 function 1 "Intel 82801JI USB" rev 0x00: apic 0 int 18
uhci2 at pci2 dev 26 function 2 "Intel 82801JI USB" rev 0x00: apic 0 int 18
ehci0 at pci2 dev 26 function 7 "Intel 82801JI USB" rev 0x00: apic 0 int 18
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00
addr 1
ppb4 at pci2 dev 28 function 0 "Intel 82801JI PCIE" rev 0x00: msi
pci7 at ppb4 bus 5
vga1 at pci7 dev 0 function 0 "Matrox MGA G200e" rev 0x02
wsdisplay at vga1 not configured
uhci3 at pci2 dev 29 function 0 "Intel 82801JI USB" rev 0x00: apic 0 int 23
uhci4 at pci2 dev 29 function 1 "Intel 82801JI USB" rev 0x00: apic 0 int 22
uhci5 at pci2 dev 29 function 2 "Intel 82801JI USB" rev 0x00: apic 0 int 21
ehci1 at pci2 dev 29 function 7 "Intel 82801JI USB" rev 0x00: apic 0 int 23
usb1 at ehci1: USB revision 2.0
uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00
addr 1
ppb5 at pci2 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0x90
pci8 at ppb5 bus 6
pcib0 at pci2 dev 31 function 0 "Intel 82801JIR LPC" rev 0x00
ahci0 at pci2 dev 31 function 2 "Intel 82801JI AHCI" rev 0x00: msi, AHCI 1.2
ahci0: port 5: 1.5Gb/s
scsibus3 at ahci0: 32 targets
cd0 at scsibus3 targ 5 lun 0: <Optiarc, DVD RW AD-7710H, 1.40> removable
ichiic0 at pci2 dev 31 function 3 "Intel 82801JI SMBus" rev 0x00: apic 0 int 17
iic0 at ichiic0
iic0: skipping sensors to avoid ipmi0 interactions
usb2 at uhci0: USB revision 1.0
uhub2 at usb2 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00
addr 1
usb3 at uhci1: USB revision 1.0
uhub3 at usb3 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00
addr 1
usb4 at uhci2: USB revision 1.0
uhub4 at usb4 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00
addr 1
usb5 at uhci3: USB revision 1.0
uhub5 at usb5 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00
addr 1
usb6 at uhci4: USB revision 1.0
uhub6 at usb6 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00
addr 1
usb7 at uhci5: USB revision 1.0
uhub7 at usb7 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00
addr 1
isa0 at pcib0
isadma0 at isa0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
vscsi0 at root
scsibus4 at vscsi0: 256 targets
softraid0 at root
scsibus5 at softraid0: 256 targets
root on sd0a (2eadf79aaeec85b0.a) swap on sd0b dump on sd0b
WARNING: / was not properly unmounted
G
