hello, woke up this morning to the following panic, upon reboot the machine almost immediately (~5 mins) panicked again, but with a slightly different message. My server is a hosted VPS, so my only console is over VNC which means there is no copy / paste functionality. After talking to sthen@ he suggested I just include the running process from the 'ps' output as it's very long, and I've captured the rest as screenshots available here:
http://www.huldtgren.com/panics/ I'll note that doing a 'boot reboot' in ddb incurs another panic for which I've included the information as well in case it's of any use. Thanks, .jh panic #1: panic: pool_do_get(mcl2k): free list modified: page 0xfffffe80b2e7a000; item addr 0xfffffe80b2e7a000; offset 0x0=0xdeadbe57 Stopped at Debugger+0x5; leave RUN AT LEAST 'trace' AND 'ps' AND INCLUDE OUTPUT WHEN REPORTING THIS PANIC! DO NOT EVEN BOTHER REPORTING THIS WITHOUT INCLUDING THAT INFORMATION! ddb> trace Debugger () at Debugger+0x5 panic() at panic+0xe4 pool_do_get() at pool_do_get+0x3d6 pool_get() at pool_get+0x4a m_clget() at m_clget+0x95 sosend() at sosend+0x386 dofilewritev() at dofilewritev+0x18b sys_write() at sys_write+0x8f syscall() at syscall+0x162 --- sys call (number 4) --- end of kernel end trace frame: 0x5ac4d9580, count: -9 0x5ad1d450a: ddb> ps PID PPID PGRP UID S FLAGS WAIT COMMAND *14372 28203 28203 518 7 0 imap-login panic #2 panic: pool_do_get(mcl2k): free list modified: page 0xfffffe80de507000; item addr 0xfffffe80de507800; offset 0x0=0x9e6f4bb4 Stopped at Debugger+0x5: leave RUN AT LEAST 'trace' AND 'ps' AND INCLUDE OUTPUT WHEN REPORTING THIS PANIC! DO NOT EVEN BOTHER REPORTING THIS WITHOUT INCLUDING THAT INFORMATION! ddb> trace Debugger() at Debugger+0x5 panic at panic+0xe4 pool_do_get() at pool_do_get+0x3d6 pool_get() at pool_get+0x4a m_clget() at m_cget+0x8b em_get_buf() at em_get_buf+0x8b em_rxfill() at em_rxfill+0x68 em_intr() at em_intr+0xc8 Xintr_legacy11() at Xintr_legacy11+0xf8 --- interrupt --- Bad frame pointer: 0xtttt80002219b410 end trace frame: 0xffff80002219b410, count: -9 x86_bus_space_io_read_4+0x8: ddb> ps PID PPID PGRP UID S FLAGS WAIT COMMAND *16225 5103 5103 70 7 0 named panic on reboot: ddb> boot reboot panic: mtx_enter: locking against myself Stopped at Debugger+0x5: leave RUN AT LEAST 'trace' AND 'ps' AND INCLUDE OUTPUT WHEN REPORTING THIS PANIC! DO NOT EVEN BOTHER REPORTING THIS WITHOUT INCLUDING THAT INFORMATION! ddb> Debugger() at Debugger+0x5 panic() at panic+0xe4 mtx_enter() at mtx_enter+0x60 m_clget() at m_clget+0x95 rt_msg1() at rt_msg1+0x73 rt_ifmesg() at rt_ifmesg+0x3d if_down() at if_down+0xb6 if_downall() at if_downall+0x5a boot() at boot+0xf2 db_boot_reboot_cmd() at db_boot_reboot_cmd+0xe db_command() at db_command+0x13a db_command_loop() at db_command_loop+0x80 db_trap() at db+trap+0xc9 kdb_trap() at kdb_trap+0xc3 trap() at trap+0x11d --- trap (number 1) --- Debugger() at Debugger+0x5 panic() at panic+0xe4 pool_do_get() at pool_do_get+0x3d6 pool_get() at pool_get+0x4a m_clget() at m_clget+0x95 em_get_buf() at em_get_bug+0x8b em_rxfill() at em_rxfill+0x68 em_intr() at em_intr+0xc8 Xintr_legacy11() at Xintr_legacy11+0xf8 --- interrupt --- Bad frame pointer: 0xffff80002219b410 end trace frame: 0xffff80002219b410, count: -24 x86_bus_space_io_read_4+0x8: ddb> ps PID PPID PGRP UID S FLAGS WAIT COMMAND *16225 5103 5103 70 7 0 named dmesg: OpenBSD 5.3-current (GENERIC) #144: Sat Apr 20 16:50:59 MDT 2013 dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC real mem = 4278124544 (4079MB) avail mem = 4156567552 (3964MB) mainbus0 at root bios0 at mainbus0: SMBIOS rev. 2.4 @ 0xfbd3f (10 entries) bios0: vendor QEMU version "QEMU" date 01/01/2007 acpi0 at bios0: rev 0 acpi0: sleep states S3 S4 S5 acpi0: tables DSDT FACP APIC acpi0: wakeup devices acpitimer0 at acpi0: 3579545 Hz, 24 bits acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat acpiprt0 at acpi0: bus 0 (PCI0) acpicpu0 at acpi0 mpbios at bios0 not configured cpu0 at mainbus0: (uniprocessor) cpu0: QEMU Virtual CPU version 0.9.1, 2667.40 MHz cpu0: FPU,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SSE3,NXE,LONG,PERF cpu0: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 512KB 64b/line 16-way L2 cache cpu0: ITLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped cpu0: DTLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped pci0 at mainbus0 bus 0 pchb0 at pci0 dev 0 function 0 "Intel 82441FX" rev 0x02 pcib0 at pci0 dev 1 function 0 "Intel 82371SB ISA" rev 0x00 pciide0 at pci0 dev 1 function 1 "Intel 82371SB IDE" rev 0x00: DMA, channel 0 wired to compatibility, channel 1 wired to compatibility wd0 at pciide0 channel 0 drive 0: <QEMU HARDDISK> wd0: 16-sector PIO, LBA48, 122880MB, 251658240 sectors atapiscsi0 at pciide0 channel 0 drive 1 scsibus0 at atapiscsi0: 2 targets cd0 at scsibus0 targ 0 lun 0: <QEMU, QEMU DVD-ROM, 0.9.> ATAPI 5/cdrom removable wd0(pciide0:0:0): using PIO mode 0, DMA mode 2 cd0(pciide0:0:1): using PIO mode 0 atapiscsi1 at pciide0 channel 1 drive 0 scsibus1 at atapiscsi1: 2 targets cd1 at scsibus1 targ 0 lun 0: <QEMU, QEMU DVD-ROM, 0.9.> ATAPI 5/cdrom removable cd1(pciide0:1:0): using PIO mode 0 uhci0 at pci0 dev 1 function 2 "Intel 82371SB USB" rev 0x01: irq 11 piixpm0 at pci0 dev 1 function 3 "Intel 82371AB Power" rev 0x03: irq 10 iic0 at piixpm0 iic0: addr 0x4c 48=00 words 00=0000 01=0000 02=0000 03=0000 04=0000 05=0000 06=0000 07=0000 iic0: addr 0x4e 48=00 words 00=0000 01=0000 02=0000 03=0000 04=0000 05=0000 06=0000 07=0000 vga1 at pci0 dev 2 function 0 "Cirrus Logic CL-GD5446" rev 0x00 wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) wsdisplay0: screen 1-5 added (80x25, vt100 emulation) em0 at pci0 dev 3 function 0 "Intel PRO/1000MT (82540EM)" rev 0x03: irq 11, address 52:54:00:4e:22:85 virtio0 at pci0 dev 4 function 0 "Qumranet Virtio Memory" rev 0x00: Virtio Memory Balloon Device viomb0 at virtio0 virtio0: irq 11 virtio1 at pci0 dev 5 function 0 "Qumranet Virtio Console" rev 0x00: Virtio Console Device virtio1: no matching child driver; not configured isa0 at pcib0 isadma0 at isa0 com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo com0: probed fifo depth: 0 bytes pckbc0 at isa0 port 0x60/5 pckbd0 at pckbc0 (kbd slot) pckbc0: using irq 1 for kbd slot wskbd0 at pckbd0: console keyboard, using wsdisplay0 pms0 at pckbc0 (aux slot #0) pckbc0: using irq 12 for aux slot #0 wsmouse0 at pms0 mux 0 pcppi0 at isa0 port 0x61 spkr0 at pcppi0 fdc0 at isa0 port 0x3f0/6 irq 6 drq 2 fd0 at fdc0 drive 0: density unknown fd1 at fdc0 drive 1: density unknown usb0 at uhci0: USB revision 1.0 uhub0 at usb0 "Intel UHCI root hub" rev 1.00/1.00 addr 1 nvram: invalid checksum mtrr: Pentium Pro MTRR support vscsi0 at root scsibus2 at vscsi0: 256 targets softraid0 at root scsibus3 at softraid0: 256 targets root on wd0a (4b9f02a7a1dfaec9.a) swap on wd0b dump on wd0b WARNING: / was not properly unmounted clock: unknown CMOS layout
