On Mon, 6 Jan 2025 19:14:40 -0000 (UTC)
Stuart Henderson <stu.li...@spacehopper.org> wrote:
> On 2025-01-06, Joel Mawhorter <j...@mawhorter.org> wrote:
> > I see a discussion from back in May in the Archives of b...@openbsd.org
> > about wg_encap_worker kernel panics. I'm running into this on a production
> > SP server running 7.6 and wonder if this is something that is currently
> > being worked on. I'm happy to help debug although this is on a server that
> > needs to be up most of the time.
>
> dmesg?
>
>
dmesg:
OpenBSD 7.6 (GENERIC) #332: Mon Sep 30 08:45:17 MDT 2024
dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC
<snip>
panic: pool_do_get: mcl2k free list modified: page 0xfffffd802aa9f000; item
addr 0xfffffd802aaa1800; offset 0x0=0x0 != 0xb6e194106221d460
Stopped at db_enter+0x14: popq %rbp
TID PID UID PRFLAGS PFLAGS CPU COMMAND
*370706 6418 0 0x14000 0x200 0 wg_crypt
db_enter() at db_enter+0x14
panic(ffffffff82337cbe) at panic+0xcf
pool_do_get(ffffffff82826770,2,ffff80001ca810e4) at pool_do_get+0x350
pool_get(ffffffff82826770,2) at pool_get+0x86
m_clget(0,2,800) at m_clget+0x1a8
vio_populate_rx_mbufs(ffff8000000ae800,ffff8000000a6f00) at
vio_populate_rx_mbufs+0x136
vio_rx_intr(ffff8000000ef000) at vio_rx_intr+0x73
intr_handler(ffff80001ca81290,ffff80000009ba80) at intr_handler+0x56
Xintr_ioapic_edge17_untramp() at Xintr_ioapic_edge17_untramp+0x18f
memset() at memset+0x5c
wg_encap_worker(ffff80000097f000) at wg_encap_worker+0x8b
taskq_thread(ffff8000000a3980) at taskq_thread+0x129
end trace frame: 0x0, count: 3
https://www.openbsd.org/ddb.html describes the minimum info required in bug
reports. Insufficient info makes it difficult to find and fix bugs.
ddb> *cpu0: pool_do_get: mcl2k free list modified: page 0xfffffd802aa9f000;
item addr 0xfffffd802aaa1800; offset 0x0=0x0 != 0xb6e194106221d460
ddb> db_enter() at db_enter+0x14
panic(ffffffff82337cbe) at panic+0xcf
pool_do_get(ffffffff82826770,2,ffff80001ca810e4) at pool_do_get+0x350
pool_get(ffffffff82826770,2) at pool_get+0x86
m_clget(0,2,800) at m_clget+0x1a8
vio_populate_rx_mbufs(ffff8000000ae800,ffff8000000a6f00) at
vio_populate_rx_mbufs+0x136
vio_rx_intr(ffff8000000ef000) at vio_rx_intr+0x73
intr_handler(ffff80001ca81290,ffff80000009ba80) at intr_handler+0x56
Xintr_ioapic_edge17_untramp() at Xintr_ioapic_edge17_untramp+0x18f
memset() at memset+0x5c
wg_encap_worker(ffff80000097f000) at wg_encap_worker+0x8b
taskq_thread(ffff8000000a3980) at taskq_thread+0x129
end trace frame: 0x0, count: -12
ddb> PID TID PPID UID S FLAGS WAIT COMMAND
24765 402193 29707 27 3 0x1100090 kqread sshd-session
29707 182558 56095 0 3 0x82 kqread sshd-session
80629 355161 56774 518 3 0x92 kqread auth
97193 188114 56774 2000 3 0x92 kqread imap
73600 214639 56774 666 3 0x1000092 kqread imap-login
32172 287605 56774 2000 3 0x92 kqread imap
56312 449015 56774 666 3 0x1000092 kqread imap-login
51732 508206 1 638 3 0x80 kqread lua54
51732 506269 1 638 3 0x4000080 kqread lua54
53882 353596 56774 518 3 0x92 kqread stats
97497 84324 522 843 3 0x100082 kqread filter-dkimsign
36270 32681 6670 95 3 0x82 sbwait table-passwd
522 70224 81516 843 3 0x90 wait smtpd
16012 180831 81516 95 3 0x1100092 kqread smtpd
29069 516634 81516 103 3 0x1100092 kqread smtpd
59846 509488 81516 95 3 0x1100092 kqread smtpd
6670 44134 81516 95 3 0x100092 kqread smtpd
47948 52362 81516 95 3 0x1100092 kqread smtpd
88772 337398 81516 95 3 0x1100092 kqread smtpd
81516 120689 1 0 3 0x100080 kqread smtpd
36877 424342 56774 0 3 0x92 kqread config
96408 449827 56774 0 3 0x92 kqread log
41392 498555 56774 518 3 0x1000092 kqread anvil
56774 140743 1 0 3 0x80 kqread dovecot
94319 435288 76823 0 3 0x100083 ttyin ksh
57722 17009 49709 1000 3 0x100083 ttyin ksh
76823 69467 49709 1000 3 0x10008b sigsusp ksh
97444 434336 49709 1000 3 0x100083 ttyin ksh
12034 66143 40237 1000 3 0x100083 kqread tmux
40237 48950 39753 1000 3 0x10008b sigsusp ksh
39753 407441 1 1000 3 0x100089 kqread mosh-server
46875 503523 59377 0 3 0x100083 ttyin ksh
59377 186421 49709 1000 3 0x10008b sigsusp ksh
49709 83814 1 1000 3 0x100080 kqread tmux
49350 64296 1 0 3 0x100083 ttyin getty
51104 509875 1 0 3 0x100083 ttyin getty
21869 226648 1 0 3 0x100083 ttyin getty
4855 96442 1 0 3 0x100083 ttyin getty
2680 168602 1 0 3 0x100083 ttyin getty
65368 144771 1 0 3 0x100098 kqread cron
93304 147817 1 795 3 0x80 kqread turnserver
93304 150712 1 795 3 0x4000080 kqread turnserver
93304 516902 1 795 3 0x4000080 kqread turnserver
93304 223396 1 795 3 0x4000080 nanoslp turnserver
93304 220774 1 795 3 0x4000080 kqread turnserver
93304 237061 1 795 3 0x4000080 kqread turnserver
93304 270754 1 795 3 0x4000080 kqread turnserver
56095 446173 1 0 3 0x88 kqread sshd
96228 189832 1 0 3 0x100080 kqread ntpd
76036 251309 86407 83 3 0x100092 kqread ntpd
86407 444283 1 83 3 0x1100092 kqread ntpd
75743 203838 1 53 3 0x1000090 kqread unbound
73246 518813 92666 74 3 0x1100092 bpf pflogd
92666 54027 1 0 3 0x80 sbwait pflogd
55396 453565 50926 73 3 0x1100090 kqread syslogd
50926 25362 1 0 3 0x100082 sbwait syslogd
* 6418 370706 0 0 7 0x14200 wg_crypt
7856 193446 0 0 3 0x14200 bored wg_handshake
89711 292779 0 0 3 0x14200 bored wg_handshake
72886 138889 1 0 3 0x100080 kqread resolvd
61028 302116 76538 77 3 0x100092 kqread dhcpleased
70042 196124 76538 77 3 0x100092 kqread dhcpleased
76538 23860 1 0 3 0x80 kqread dhcpleased
3737 239369 40116 115 3 0x100092 kqread slaacd
41560 64459 40116 115 3 0x100092 kqread slaacd
40116 189442 1 0 3 0x100080 kqread slaacd
54141 147791 0 0 3 0x14200 bored smr
54869 175919 0 0 3 0x14200 pgzero zerothread
2755 32444 0 0 3 0x14200 aiodoned aiodoned
1826 505877 0 0 3 0x14200 syncer update
41009 284646 0 0 3 0x14200 cleaner cleaner
10919 77515 0 0 3 0x14200 reaper reaper
74759 476322 0 0 3 0x14200 pgdaemon pagedaemon
87497 186273 0 0 3 0x14200 bored viomb
70266 415681 0 0 3 0x14200 usbtsk usbtask
28730 202804 0 0 3 0x14200 usbatsk usbatsk
97825 401230 0 0 3 0x14200 bored wsdisplay0
60382 142119 0 0 3 0x40014200 acpi0 acpi0
58631 206667 0 0 3 0x14200 bored softnet3
92667 286409 0 0 3 0x14200 bored softnet2
7871 248633 0 0 3 0x14200 bored softnet1
43112 356351 0 0 2 0x14200 softnet0
33525 414918 0 0 3 0x14200 bored systqmp
13122 240839 0 0 3 0x14200 bored systq
4937 508521 0 0 3 0x40014200 tmoslp softclock
14262 294720 0 0 3 0x40014200 idle0
1 69256 0 0 3 0x82 wait init
0 0 -1 0 3 0x10200 scheduler swapper
Is that enough to start? I wasn't sure whether to send debugging info or not.
Joel
