On 2025-01-06, Joel Mawhorter <j...@mawhorter.org> wrote: > On Mon, 6 Jan 2025 19:14:40 -0000 (UTC) > Stuart Henderson <stu.li...@spacehopper.org> wrote: > >> On 2025-01-06, Joel Mawhorter <j...@mawhorter.org> wrote: >> > I see a discussion from back in May in the Archives of b...@openbsd.org >> > about wg_encap_worker kernel panics. I'm running into this on a production >> > SP server running 7.6 and wonder if this is something that is currently >> > being worked on. I'm happy to help debug although this is on a server that >> > needs to be up most of the time. >> >> dmesg? >> >> > > dmesg: > > OpenBSD 7.6 (GENERIC) #332: Mon Sep 30 08:45:17 MDT 2024 > dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC > > ><snip>
That <snip>ped section was the bit I wanted to see. > panic: pool_do_get: mcl2k free list modified: page 0xfffffd802aa9f000; item > addr 0xfffffd802aaa1800; offset 0x0=0x0 != 0xb6e194106221d460 > Stopped at db_enter+0x14: popq %rbp > TID PID UID PRFLAGS PFLAGS CPU COMMAND > > *370706 6418 0 0x14000 0x200 0 wg_crypt > > db_enter() at db_enter+0x14 > panic(ffffffff82337cbe) at panic+0xcf > pool_do_get(ffffffff82826770,2,ffff80001ca810e4) at pool_do_get+0x350 > pool_get(ffffffff82826770,2) at pool_get+0x86 > m_clget(0,2,800) at m_clget+0x1a8 > vio_populate_rx_mbufs(ffff8000000ae800,ffff8000000a6f00) at > vio_populate_rx_mbufs+0x136 > vio_rx_intr(ffff8000000ef000) at vio_rx_intr+0x73 > intr_handler(ffff80001ca81290,ffff80000009ba80) at intr_handler+0x56 > Xintr_ioapic_edge17_untramp() at Xintr_ioapic_edge17_untramp+0x18f > memset() at memset+0x5c > wg_encap_worker(ffff80000097f000) at wg_encap_worker+0x8b > taskq_thread(ffff8000000a3980) at taskq_thread+0x129 > end trace frame: 0x0, count: 3 > https://www.openbsd.org/ddb.html describes the minimum info required in bug > reports. Insufficient info makes it difficult to find and fix bugs. > ddb> *cpu0: pool_do_get: mcl2k free list modified: page 0xfffffd802aa9f000; > item addr 0xfffffd802aaa1800; offset 0x0=0x0 != 0xb6e194106221d460 > ddb> db_enter() at db_enter+0x14 > panic(ffffffff82337cbe) at panic+0xcf > pool_do_get(ffffffff82826770,2,ffff80001ca810e4) at pool_do_get+0x350 > pool_get(ffffffff82826770,2) at pool_get+0x86 > m_clget(0,2,800) at m_clget+0x1a8 > vio_populate_rx_mbufs(ffff8000000ae800,ffff8000000a6f00) at > vio_populate_rx_mbufs+0x136 > vio_rx_intr(ffff8000000ef000) at vio_rx_intr+0x73 > intr_handler(ffff80001ca81290,ffff80000009ba80) at intr_handler+0x56 > Xintr_ioapic_edge17_untramp() at Xintr_ioapic_edge17_untramp+0x18f > memset() at memset+0x5c > wg_encap_worker(ffff80000097f000) at wg_encap_worker+0x8b > taskq_thread(ffff8000000a3980) at taskq_thread+0x129 > end trace frame: 0x0, count: -12 > ddb> PID TID PPID UID S FLAGS WAIT COMMAND > > 24765 402193 29707 27 3 0x1100090 kqread sshd-session > 29707 182558 56095 0 3 0x82 kqread sshd-session > 80629 355161 56774 518 3 0x92 kqread auth > 97193 188114 56774 2000 3 0x92 kqread imap > 73600 214639 56774 666 3 0x1000092 kqread imap-login > 32172 287605 56774 2000 3 0x92 kqread imap > 56312 449015 56774 666 3 0x1000092 kqread imap-login > 51732 508206 1 638 3 0x80 kqread lua54 > 51732 506269 1 638 3 0x4000080 kqread lua54 > 53882 353596 56774 518 3 0x92 kqread stats > 97497 84324 522 843 3 0x100082 kqread filter-dkimsign > 36270 32681 6670 95 3 0x82 sbwait table-passwd > 522 70224 81516 843 3 0x90 wait smtpd > 16012 180831 81516 95 3 0x1100092 kqread smtpd > 29069 516634 81516 103 3 0x1100092 kqread smtpd > 59846 509488 81516 95 3 0x1100092 kqread smtpd > 6670 44134 81516 95 3 0x100092 kqread smtpd > 47948 52362 81516 95 3 0x1100092 kqread smtpd > 88772 337398 81516 95 3 0x1100092 kqread smtpd > 81516 120689 1 0 3 0x100080 kqread smtpd > 36877 424342 56774 0 3 0x92 kqread config > 96408 449827 56774 0 3 0x92 kqread log > 41392 498555 56774 518 3 0x1000092 kqread anvil > 56774 140743 1 0 3 0x80 kqread dovecot > 94319 435288 76823 0 3 0x100083 ttyin ksh > 57722 17009 49709 1000 3 0x100083 ttyin ksh > 76823 69467 49709 1000 3 0x10008b sigsusp ksh > 97444 434336 49709 1000 3 0x100083 ttyin ksh > 12034 66143 40237 1000 3 0x100083 kqread tmux > 40237 48950 39753 1000 3 0x10008b sigsusp ksh > 39753 407441 1 1000 3 0x100089 kqread mosh-server > 46875 503523 59377 0 3 0x100083 ttyin ksh > 59377 186421 49709 1000 3 0x10008b sigsusp ksh > 49709 83814 1 1000 3 0x100080 kqread tmux > 49350 64296 1 0 3 0x100083 ttyin getty > 51104 509875 1 0 3 0x100083 ttyin getty > 21869 226648 1 0 3 0x100083 ttyin getty > 4855 96442 1 0 3 0x100083 ttyin getty > 2680 168602 1 0 3 0x100083 ttyin getty > 65368 144771 1 0 3 0x100098 kqread cron > 93304 147817 1 795 3 0x80 kqread turnserver > 93304 150712 1 795 3 0x4000080 kqread turnserver > 93304 516902 1 795 3 0x4000080 kqread turnserver > 93304 223396 1 795 3 0x4000080 nanoslp turnserver > 93304 220774 1 795 3 0x4000080 kqread turnserver > 93304 237061 1 795 3 0x4000080 kqread turnserver > 93304 270754 1 795 3 0x4000080 kqread turnserver > 56095 446173 1 0 3 0x88 kqread sshd > 96228 189832 1 0 3 0x100080 kqread ntpd > 76036 251309 86407 83 3 0x100092 kqread ntpd > 86407 444283 1 83 3 0x1100092 kqread ntpd > 75743 203838 1 53 3 0x1000090 kqread unbound > 73246 518813 92666 74 3 0x1100092 bpf pflogd > 92666 54027 1 0 3 0x80 sbwait pflogd > 55396 453565 50926 73 3 0x1100090 kqread syslogd > 50926 25362 1 0 3 0x100082 sbwait syslogd > * 6418 370706 0 0 7 0x14200 wg_crypt > 7856 193446 0 0 3 0x14200 bored wg_handshake > 89711 292779 0 0 3 0x14200 bored wg_handshake > 72886 138889 1 0 3 0x100080 kqread resolvd > 61028 302116 76538 77 3 0x100092 kqread dhcpleased > 70042 196124 76538 77 3 0x100092 kqread dhcpleased > 76538 23860 1 0 3 0x80 kqread dhcpleased > 3737 239369 40116 115 3 0x100092 kqread slaacd > 41560 64459 40116 115 3 0x100092 kqread slaacd > 40116 189442 1 0 3 0x100080 kqread slaacd > 54141 147791 0 0 3 0x14200 bored smr > 54869 175919 0 0 3 0x14200 pgzero zerothread > 2755 32444 0 0 3 0x14200 aiodoned aiodoned > 1826 505877 0 0 3 0x14200 syncer update > 41009 284646 0 0 3 0x14200 cleaner cleaner > 10919 77515 0 0 3 0x14200 reaper reaper > 74759 476322 0 0 3 0x14200 pgdaemon pagedaemon > 87497 186273 0 0 3 0x14200 bored viomb > 70266 415681 0 0 3 0x14200 usbtsk usbtask > 28730 202804 0 0 3 0x14200 usbatsk usbatsk > 97825 401230 0 0 3 0x14200 bored wsdisplay0 > 60382 142119 0 0 3 0x40014200 acpi0 acpi0 > 58631 206667 0 0 3 0x14200 bored softnet3 > 92667 286409 0 0 3 0x14200 bored softnet2 > 7871 248633 0 0 3 0x14200 bored softnet1 > 43112 356351 0 0 2 0x14200 softnet0 > 33525 414918 0 0 3 0x14200 bored systqmp > 13122 240839 0 0 3 0x14200 bored systq > 4937 508521 0 0 3 0x40014200 tmoslp softclock > 14262 294720 0 0 3 0x40014200 idle0 > 1 69256 0 0 3 0x82 wait init > 0 0 -1 0 3 0x10200 scheduler swapper > > > Is that enough to start? I wasn't sure whether to send debugging info or not. > > Joel > > -- Please keep replies on the mailing list.
