Hi, While booting with OpenBSD 7.3-current (GENERIC.MP) #153: Sat Jul 15 16:24:01 MDT 2023 dera...@macppc.openbsd.org:/usr/src/sys/arch/macppc/compile/GENERIC.MP Machine paniced in rc reordering.
reordering: ld.so libc libcrypto sshdpanic: pool_do_get: vp: page empty Stopped at db_enter+0x24: lwz r11,12(r1) TID PID UID PRFLAGS PFLAGS CPU COMMAND *286053 66409 0 0x100001 0 0 sh db_enter() at db_enter+0x20 panic(908034) at panic+0x158 pool_do_get(0,6099c84b,68969083) at pool_do_get+0x370 pool_get(0,66b85b77) at pool_get+0xc4 pmap_vp_enter(1fff1a4,1fff0d8,e8024cb0,d15639f) at pmap_vp_enter+0xa4 pmap_enter(e8024e38,e8024db4,1f1f738,5f1d38bd,2420d042) at pmap_enter+0x1e0 uvm_fault_lower(e8024e58,0,e8024da0,427814) at uvm_fault_lower+0x900 uvm_fault(0,0,0,0) at uvm_fault+0x20c trap(0) at trap+0x238 trapagain() at trapagain+0x4 --- trap (type 0x10400) --- End of kernel: 0xfffe6810 end trace frame: 0xfffe6810, count: 5 https://www.openbsd.org/ddb.html describes the minimum info required in bug reports. Insufficient info makes it difficult to find and fix bugs. ddb{0}> [-- MARK -- Tue Jul 18 00:50:00 2023] ddb{0}> trace db_enter() at db_enter+0x20 panic(908034) at panic+0x158 pool_do_get(0,6099c84b,68969083) at pool_do_get+0x370 pool_get(0,66b85b77) at pool_get+0xc4 pmap_vp_enter(1fff1a4,1fff0d8,e8024cb0,d15639f) at pmap_vp_enter+0xa4 pmap_enter(e8024e38,e8024db4,1f1f738,5f1d38bd,2420d042) at pmap_enter+0x1e0 uvm_fault_lower(e8024e58,0,e8024da0,427814) at uvm_fault_lower+0x900 uvm_fault(0,0,0,0) at uvm_fault+0x20c trap(0) at trap+0x238 trapagain() at trapagain+0x4 --- trap (type 0x10400) --- End of kernel: 0xfffe6810 end trace frame: 0xfffe6810, count: -10 ddb{0}> show panic *cpu0: pool_do_get: vp: page empty ddb{0}> ps PID TID PPID UID S FLAGS WAIT COMMAND *66409 286053 13174 0 7 0x100001 sh 13174 311294 57279 0 3 0x100089 sigsusp sh 89034 307491 1 0 3 0x100080 kqread resolvd 34301 100707 86871 77 3 0x100092 kqread dhcpleased 54366 69070 86871 77 3 0x100092 kqread dhcpleased 86871 362535 1 0 3 0x80 kqread dhcpleased 98114 186276 3166 115 3 0x100092 kqread slaacd 56689 38807 3166 115 3 0x100092 kqread slaacd 3166 469092 1 0 3 0x100080 kqread slaacd 57279 55427 76112 0 3 0x100089 sigsusp sh 76112 10156 1 0 3 0x100083 piperd sh 22123 127478 0 0 3 0x14200 bored smr 82693 204230 0 0 3 0x40014200 idle1 68536 190476 0 0 3 0x14200 pgzero zerothread 4888 454542 0 0 3 0x14200 aiodoned aiodoned 82385 475789 0 0 3 0x14200 syncer update 78872 23710 0 0 3 0x14200 cleaner cleaner 20471 388019 0 0 3 0x14200 reaper reaper 20260 360822 0 0 3 0x14200 pgdaemon pagedaemon 76712 160794 0 0 3 0x14200 usbtsk usbtask 37718 40013 0 0 3 0x14200 usbatsk usbatsk 89295 189330 0 0 3 0x14200 bored sensors 98074 514874 0 0 3 0x14200 bored softnet3 90862 520613 0 0 3 0x14200 bored softnet2 11008 97579 0 0 3 0x14200 bored softnet1 13848 442973 0 0 3 0x14200 bored softnet0 6945 155368 0 0 3 0x14200 bored systqmp 97083 254902 0 0 3 0x14200 bored systq 27429 306600 0 0 3 0x40014200 bored softclock 12027 511656 0 0 3 0x40014200 idle0 1 106847 0 0 3 0x82 wait init 0 0 -1 0 3 0x10200 scheduler swapper ddb{0}> show uvm Current UVM status: pagesize=4096 (0x1000), pagemask=0xfff, pageshift=12 500848 VM pages: 1622 active, 17805 inactive, 1 wired, 442406 free (55607 zero) min 10% (25) anon, 10% (25) vnode, 5% (12) vtext freemin=16694, free-target=22258, inactive-target=0, wired-max=166949 faults=106581, traps=0, intrs=12014, ctxswitch=42307 fpuswitch=12977 softint=5524, syscalls=166272, kmapent=10 fault counts: noram=0, noanon=0, noamap=0, pgwait=0, pgrele=0 ok relocks(total)=19763(19794), anget(retries)=51906(0), amapcopy=21501 neighbor anon/obj pg=16262/31978, gets(lock/unlock)=34379/21189 cases: anon=46026, anoncow=5943, obj=32098, prcopy=3869, przero=20398 daemon and swap counts: woke=0, revs=0, scans=0, obscans=0, anscans=0 busy=0, freed=0, reactivate=0, deactivate=0 pageouts=0, pending=0, nswget=0 nswapdev=1 swpages=786491, swpginuse=0, swpgonly=0 paging=0 kernel pointers: objs(kern)=0xb31c78 After reboot fsck made no progress, after Ctrl-C kenrel paniced again. load: 4.00 cmd: fsck_ffs 64619 [running] 17623.46u 11.61s 98% 1913k^M 6102496318219727.f: phase 2, directory 30155/51251 ^Cpanic: kernel diagnostic assertion "anon->an_page == NULL" failed: file "/usr/s rc/sys/uvm/uvm_anon.c", line 132 Stopped at db_enter+0x24: lwz r11,12(r1) TID PID UID PRFLAGS PFLAGS CPU COMMAND *108779 77589 0 0x14000 0x200 0 reaper db_enter() at db_enter+0x20 panic(907c94) at panic+0x158 __assert(30f81100,7c5c278,e7fc9de0,2bba9c) at __assert+0x2c uvm_anfree_list(4574ec37,f) at uvm_anfree_list+0x22c amap_wipeout(abda90) at amap_wipeout+0x174 amap_unref(9495aaa4,3146aab8,0,1) at amap_unref+0x70 uvm_unmap_detach(be34be3a,b896611d) at uvm_unmap_detach+0x9c uvm_map_teardown(0) at uvm_map_teardown+0x1c8 uvmspace_free(b3313c) at uvmspace_free+0x60 uvm_exit(b3313c) at uvm_exit+0x30 reaper(ab6c04) at reaper+0x138 proc_trampoline() at proc_trampoline+0x14 end trace frame: 0x0, count: 3 https://www.openbsd.org/ddb.html describes the minimum info required in bug reports. Insufficient info makes it difficult to find and fix bugs. ddb{0}> [-- MARK -- Tue Jul 18 22:00:00 2023] Subsequent reboots and fsck causes other panics. load: 0.22 cmd: fsck_ffs 57239 [running] 22.08u 5.84s 67% 1210k^M 6102496318219727.f: phase 1, inode 2053312/2643840 panic: trap type 400 srr1 40009032 at fffffffc (_end+0xff4cacd4) lr ffffffff Stopped at db_enter+0x24: lwz r11,12(r1) TID PID UID PRFLAGS PFLAGS CPU COMMAND *165623 57239 0 0x100003 0 0 fsck_ffs db_enter() at db_enter+0x20 panic(8f605f) at panic+0x158 trap(abda90) at trap+0xc50 trapagain() at trapagain+0x4 --- trap (type 0x400) --- _end() at 0xfffffffb splx(0) at splx+0x30 brelse(e7ff6bb8) at brelse+0x44c _end() at 0x7518e9e0 mtx_enter_try(be34be3a) at mtx_enter_try+0x5c splx(1000) at splx+0x30 mtx_leave(e51f29e5) at mtx_leave+0x90 pool_lock_mtx_leave(b2a2f0) at pool_lock_mtx_leave+0x20 pool_get(0,4553ae2) at pool_get+0x128 pmap_enter(e7ff6e38,e7ff6db4,4d7d340,e3f2a63e,2420d022) at pmap_enter+0x480 end trace frame: 0xe7ff6d20, count: 0 https://www.openbsd.org/ddb.html describes the minimum info required in bug reports. Insufficient info makes it difficult to find and fix bugs. ddb{0}> [-- MARK -- Tue Jul 18 22:05:00 2023] I was able to repair file system with this kernel: OpenBSD 7.3-current (GENERIC.MP) #143: Wed Jun 21 05:29:27 MDT 2023 dera...@macppc.openbsd.org:/usr/src/sys/arch/macppc/compile/GENERIC.MP Regress testing succeeded with this kernel: OpenBSD 7.3-current (GENERIC.MP) #151: Tue Jul 11 18:15:19 MDT 2023 dera...@macppc.openbsd.org:/usr/src/sys/arch/macppc/compile/GENERIC.MP So I guess something in pmap or uvm is wrong. It happend between Tue Jul 11 and Sat Jul 15 macppc snapshot. Full console output with bad kernel, hangs at reordering sshd: >> OpenBSD/macppc BOOT 1.11 boot> boot bsd booting /ht/pci@5/k2-sata-root/k2-sata@0/disk@0:bsd: 10173072+526488 [420631+104+449376+466020]=0x0 [ using 1336664 bytes of bsd ELF symbol table ] Copyright (c) 1982, 1986, 1989, 1991, 1993 The Regents of the University of California. All rights reserved. Copyright (c) 1995-2023 OpenBSD. All rights reserved. https://www.OpenBSD.org OpenBSD 7.3-current (GENERIC.MP) #153: Sat Jul 15 16:24:01 MDT 2023 dera...@macppc.openbsd.org:/usr/src/sys/arch/macppc/compile/GENERIC.MP real mem = 2147483648 (2048MB) avail mem = 2051371008 (1956MB) random: good seed from bootblocks mpath0 at root scsibus0 at mpath0: 256 targets mainbus0 at root: model PowerMac7,3 cpu0 at mainbus0: 970 (Revision 0x202): 1800 MHz cpu1 at mainbus0: 970 (Revision 0x202): 1800 MHz mem0 at mainbus0 spdmem0 at mem0: 1GB DDR SDRAM non-parity PC3200CL3.0 spdmem1 at mem0: 1GB DDR SDRAM non-parity PC3200CL3.0 spdmem2 at mem0: 512MB DDR SDRAM non-parity PC3200CL2.5 spdmem3 at mem0: 512MB DDR SDRAM non-parity PC3200CL2.5 memc0 at mainbus0: u3 rev 0xb3 kiic0 at memc0 offset 0xf8001000 iic0 at kiic0 lmtemp0 at iic0 addr 0x4a: ds1775 maxtmp0 at iic0 addr 0x4c: max6690 maxtmp1 at iic0 addr 0x4e: max6690 "cy28508" at iic0 addr 0x69 not configured "cy2213" at iic0 addr 0x65 not configured fcu0 at iic0 addr 0xaf "pca9556" at iic0 addr 0x18 not configured adc0 at iic0 addr 0x2c: ad7417 "24256" at iic0 addr 0x50 not configured "pca9556" at iic0 addr 0x19 not configured adc1 at iic0 addr 0x2d: ad7417 "24256" at iic0 addr 0x51 not configured "dart" at memc0 offset 0xf8033000 not configured "mpic" at memc0 offset 0xf8040000 not configured mpcpcibr0 at mainbus0 pci: u3-agp pci0 at mpcpcibr0 bus 0 0:16:0: mem address conflict 0xb0000000/0x10000000 pchb0 at pci0 dev 11 function 0 "Apple U3 AGP" rev 0x00 appleagp0 at pchb0 agp0 at appleagp0: aperture at 0x0, size 0x10000000 radeondrm0 at pci0 dev 16 function 0 "ATI Radeon 9600" rev 0x00: can't reserve framebuffer space "ATI Radeon 9600 XT Sec" rev 0x00 at pci0 dev 16 function 1 not configured ht0 at mainbus0: u3-ht, 6 devices pci1 at ht0 bus 0 hpb0 at pci1 dev 1 function 0 "Apple U3" rev 0x00: 85 sources pci2 at hpb0 bus 1 macobio0 at pci2 dev 7 function 0 "Apple K2 Macio" rev 0x60 openpic0 at macobio0 offset 0x40000: version 0x4614 feature 770302 LE macgpio0 at macobio0 offset 0x50 "pmu-interrupt" at macgpio0 offset 0x9 not configured "programmer-switch" at macgpio0 offset 0x11 not configured "modem-reset" at macgpio0 offset 0x1d not configured "modem-power" at macgpio0 offset 0x1e not configured "fcu-interrupt" at macgpio0 offset 0x15 not configured "fcu-hw-reset" at macgpio0 offset 0x3a not configured "slewing-done" at macgpio0 offset 0x23 not configured "codec-input-data-mux" at macgpio0 offset 0xb not configured "line-input-detect" at macgpio0 offset 0xc not configured "codec-error-irq" at mpio0 offset 0x17 not configured "codec-irq" at macgpio0 offset 0x18 not configured "headphone-mute" at macgpio0 offset 0x1f not configured "amp-mute" at macgpio0 offset 0x20 not configured "hw-reset" at macgpio0 offset 0x24 not configured "line-output-mute" at macgpio0 offset 0x25 not configured "codec-clock-mux" at macgpio0 offset 0x26 not configured "escc-legacy" at macobio0 offset 0x12000 not configured zs0 at macobio0 offset 0x13000: irq 22,23 zstty0 at zs0 channel 0: console zstty1 at zs0 channel 1 kiic1 at macobio0 offset 0x18000 iic1 at kiic1 aoa0 at macobio0 offset 0x10000: irq 30,1,2 "timer" at macobio0 offset 0x15000 not configured adb0 at macobio0 offset 0x16000 apm0 at adb0: battery flags 0x9, 0% charged piic0 at adb0 iic2 at piic0 "fans" at macobio0 offset 0x4c not configured audio0 at aoa0 ohci0 at pci2 dev 8 function 0 "Apple K2 USB" rev 0x00: irq 27, version 1.0, legacy support ohci1 at pci2 dev 9 function 0 "Apple K2 USB" rev 0x00: irq 28, version 1.0, legacy support usb0 at ohci0: USB revision 1.0 uhub0 at usb0 configuration 1 interface 0 "Apple OHCI root hub" rev 1.00/1.00 addr 1 usb1 at ohci1: USB revision 1.0 uhub1 at usb1 configuration 1 interface 0 "Apple OHCI root hub" rev 1.00/1.00 addr 1 ppb0 at pci1 dev 2 function 0 "Apple U3" rev 0x00 pci3 at ppb0 bus 5 bwi0 at pci3 dev 1 function 0 "Broadcom BCM4306" rev 0x03: irq 57, address 00:16:cb:f7:9f:42 em0 at pci3 dev 4 function 0 "Intel 82546GB" rev 0x03: irq 54, address 00:1b:21:30:3c:50 em1 at pci3 dev 4 function 1 "Intel 82546GB" rev 0x03: irq 54, address 00:1b:21:30:3c:51 ohci2 at pci3 dev 11 function 0 "NEC USB" rev 0x43: irq 63, version 1.0 ohci3 at pci3 dev 11 function 1 "NEC USB" rev 0x43: irq 63, version 1.0 ehci0 at pci3 dev 11 function 2 "NEC USB" rev 0x04: irq 63 usb2 at ehci0: USB revision 2.0 uhub2 at usb2 configuration 1 interface 0 "NEC EHCI root hub" rev 2.00/1.00 addr 1 usb3 at ohci2: USB revision 1.0 uhub3 at usb3 configuration 1 interface 0 "NEC OHCI root hub" rev 1.00/1.00 addr 1 usb4 at ohci3: USB revision 1.0 uhub4 at usb4 configuration 1 interface 0 "NEC OHCI root hub" rev 1.00/1.00 addr 1 ppb1 at pci1 dev 3 function 0 "Apple U3" rev 0x00 pci4 at ppb1 bus 2 kauaiata0 at pci4 dev 13 function 0 "Apple K2 ATA" rev 0x00 wdc0 at kauaiata0 irq 39: DMA atapiscsi0 at wdc0 channel 0 drive 0 scsibus1 at atapiscsi0: 2 targets cd0 at scsibus1 targ 0 lun 0: <PIONEER, DVD-RW DVR-117D, B705> removable cd0(wdc0:0:0): using PIO mode 4, DMA mode 2, Ultra-DMA mode 4 "Apple K2 Firewire" rev 0x00 at pci4 dev 14 function 0 not configured ppb2 at pci1 dev 4 function 0 "Apple U3" rev 0x00 pci5 at ppb2 bus 3 gem0 at pci5 dev 15 function 0 "Apple K2 GMAC" rev 0x00: irq 41, address 00:0d:93:55:51:d2 brgphy0 at gem0 phy 1: BCM54K2 10/100/1000baseT PHY, rev. 0 ppb3 at pci1 dev 5 function 0 "Apple U3" rev 0x00 pci6 at ppb3 bus 4 pciide0 at pci6 dev 12 function 0 "ServerWorks K2 SATA" rev 0x00: DMA pciide0: using irq 0 for native-PCI interrupt pciide0: port 0: 1.5Gb/s wd0 at pciide0 channel 0 drive 0: <ST380013AS> wd0: 16-sector PIO, LBA48, 76319MB, 156301488 sectors wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 6 pciide0: port 1: PHY offline pciide0: port 2: PHY offline pciide0: port 3: PHY offline vscsi0 at root scsibus2 at vscsi0: 256 targets softraid0 at root scsibus3 at softraid0: 256 targets bootpath: /ht/pci@5/k2-sata-root/k2-sata@0/disk@0:/bsd root on wd0a (6102496318219727.a) swap on wd0b dump on wd0b Automatic boot in progress: starting file system checks. /dev/wd0a (6102496318219727.a): file system is clean; not checking /dev/wd0l (6102496318219727.l): file system is clean; not checking /dev/wd0d (6102496318219727.d): file system is clean; not checking /dev/wd0f (6102496318219727.f): file system is clean; not checking /dev/wd0g (6102496318219727.g): file system is clean; not checking /dev/wd0h (6102496318219727.h): file system is clean; not checking /dev/wd0j (6102496318219727.j): file system is clean; not checking /dev/wd0k (6102496318219727.k): file system is clean; not checking /dev/wd0e (6102496318219727.e): file system is clean; not checking pf enabled ddb.console: 0 -> 1 ddb.log: 1 -> 0 ddb.max_line: 24 -> 0 ddb.max_width: 80 -> 0 kern.allowdt: 0 -> 1 kern.allowkmem: 0 -> 1 kern.nosuidcoredump: 1 -> 3 kern.pool_debug: 1 -> 1 kern.splassert: 1 -> 2 sysctl: kern.witness.watch: specification is incomplete net.inet.etherip.allow: 0 -> 1 net.inet.ip.forwarding: 0 -> 1 net.inet.ipcomp.enable: 0 -> 1 net.inet.ipip.allow: 0 -> 1 net.inet6.ip6.forwarding: 0 -> 1 vm.malloc_conf: -> CFGJU starting network reordering: ld.so libc libcrypto sshd[-- MARK -- Tue Jul 18 22:20:00 2023]