I have had a kernel panic that took down my system, and I was
wondering if someone
can provide some insight into where I can begin with this. I had to
reboot the machine
to get it back up, but I did run a trace and grabbed the output from
dmesg before I
rebooted.
If this isn't enough information, can someone help me out with what I
should capture
before rebooting to get the machine back up and running?
Unfortunately, I can't
consistently cause this crash so testing is a bit difficult.
Thank you for any assistance.
ddb{0}> trace
Debugger() at Debugger+0x5
panic() at panic+0xe4
ffs1_reallocblks() at ffs1_reallocblks
ufs_makeinode() at ufs_makeinode+0x88
ufs_create() at ufs_create+0x35
VOP_CREATE() at VOP_CREATE+0x30
vn_open() at vn_open+0x2ad
doopenat() at doopenat+0x125
syscall() at syscall+0x249
--- syscall (number 5) ---
end of kernel
end trace frame: 0x8, count: -9
0x20f95f1ca:
ddb{0}> dmesg
OpenBSD 5.3-beta (GENERIC.MP) #36: Sun Feb 17 13:24:31 MST 2013
dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 2118475776 (2020MB)
avail mem = 2039652352 (1945MB)
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.7 @ 0xeb4c0 (54 entries)
bios0: vendor American Megatrends Inc. version "2.00" date 05/08/2012
bios0: Supermicro X9SCI/X9SCA
acpi0 at bios0: rev 2
acpi0: sleep states S0 S1 S4 S5
acpi0: tables DSDT FACP APIC FPDT MCFG PRAD HPET SSDT SPMI SSDT SPCR
EINJ ERST H
EST BERT
acpi0: wakeup devices PS2K(S4) PS2M(S4) UAR1(S4) UAR2(S4) P0P1(S4)
USB1(S4) USB
2(S4) USB3(S4) USB4(S4) USB5(S4) USB6(S4) USB7(S4) PXSX(S4) RP01(S4)
PXSX(S4) R
P02(S4) PXSX(S4) RP03(S4) PXSX(S4) RP04(S4) PXSX(S4) RP05(S4) PXSX(S4)
RP06(S4)
PXSX(S4) RP07(S4) PXSX(S4) RP08(S4) PEGP(S4) PEG0(S4) PEG1(S4) PEG2(S4)
PEG3(S
4) GLAN(S4) EHC1(S4) EHC2(S4) HDEF(S4) PWRB(S4)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) CPU E31220 @ 3.10GHz, 3093.43 MHz
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,C
FLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,V
MX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,A
ES,XSAVE,AVX,NXE,LONG,LAHF,PERF,ITSC
cpu0: 256KB 64b/line 8-way L2 cache
cpu0: apic clock running at 99MHz
cpu1 at mainbus0: apid 2 (application processor)
cpu1: Intel(R) Xeon(R) CPU E31220 @ 3.10GHz, 3092.98 MHz
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,C
FLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,V
MX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,A
ES,XSAVE,AVX,NXE,LONG,LAHF,PERF,ITSC
cpu1: 256KB 64b/line 8-way L2 cache
cpu2 at mainbus0: apid 4 (application processor)
cpu2: Intel(R) Xeon(R) CPU E31220 @ 3.10GHz, 3092.98 MHz
cpu2:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,C
FLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,V
MX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,A
ES,XSAVE,AVX,NXE,LONG,LAHF,PERF,ITSC
cpu2: 256KB 64b/line 8-way L2 cache
cpu3 at mainbus0: apid 6 (application processor)
cpu3: Intel(R) Xeon(R) CPU E31220 @ 3.10GHz, 3092.98 MHz
cpu3:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,C
FLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,V
MX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,A
ES,XSAVE,AVX,NXE,LONG,LAHF,PERF,ITSC
cpu3: 256KB 64b/line 8-way L2 cache
ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 20, 24 pins
acpimcfg0 at acpi0 addr 0xf8000000, bus 0-63
acpihpet0 at acpi0: 14318179 Hz
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 8 (P0P1)
acpiprt2 at acpi0: bus 5 (RP01)
acpiprt3 at acpi0: bus -1 (RP02)
acpiprt4 at acpi0: bus -1 (RP03)
acpiprt5 at acpi0: bus -1 (RP04)
acpiprt6 at acpi0: bus 6 (RP05)
acpiprt7 at acpi0: bus 7 (RP06)
acpiprt8 at acpi0: bus -1 (RP07)
acpiprt9 at acpi0: bus -1 (RP08)
acpiprt10 at acpi0: bus 1 (PEG0)
acpiprt11 at acpi0: bus -1 (PEG1)
acpiprt12 at acpi0: bus -1 (PEG2)
acpiprt13 at acpi0: bus -1 (PEG3)
acpiec0 at acpi0: Failed to read resource settings
acpicpu0 at acpi0: C1
acpicpu1 at acpi0: C1
acpicpu2 at acpi0: C1
acpicpu3 at acpi0: C1
acpipwrres0 at acpi0: FN00
acpipwrres1 at acpi0: FN01
acpipwrres2 at acpi0: FN02
acpipwrres3 at acpi0: FN03
acpipwrres4 at acpi0: FN04
acpitz0 at acpi0: critical temperature is 95 degC
acpitz1 at acpi0: critical temperature is 95 degC
acpibat0 at acpi0: BAT0 not present
acpibat1 at acpi0: BAT1 not present
acpibat2 at acpi0: BAT2 not present
acpibtn0 at acpi0: PWRB
acpibtn1 at acpi0: LID0
acpivideo0 at acpi0: GFX0
acpivout0 at acpivideo0: DD02
ipmi at mainbus0 not configured
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel Xeon E3-1200 Host" rev 0x09
ppb0 at pci0 dev 1 function 0 "Intel Core 2G PCIE" rev 0x09: msi
pci1 at ppb0 bus 1
ppb1 at pci1 dev 0 function 0 vendor "IDT", unknown product 0x8061 rev 0x01
pci2 at ppb1 bus 2
ppb2 at pci2 dev 2 function 0 vendor "IDT", unknown product 0x8061 rev 0x01
pci3 at ppb2 bus 3
bnx0 at pci3 dev 0 function 0 "Broadcom BCM5709" rev 0x20: apic 2 int 18
bnx1 at pci3 dev 0 function 1 "Broadcom BCM5709" rev 0x20: apic 2 int 19
ppb3 at pci2 dev 4 function 0 vendor "IDT", unknown product 0x8061 rev 0x01
pci4 at ppb3 bus 4
bnx2 at pci4 dev 0 function 0 "Broadcom BCM5709" rev 0x20: apic 2 int 16
bnx3 at pci4 dev 0 function 1 "Broadcom BCM5709" rev 0x20: apic 2 int 17
"Intel 6 Series MEI" rev 0x04 at pci0 dev 22 function 0 not configured
vendor "Intel", unknown product 0x1c3b (class communications subclass
miscellan
eous, rev 0x04) at pci0 dev 22 function 1 not configured
ehci0 at pci0 dev 26 function 0 "Intel 6 Series USB" rev 0x05: apic 2 int 16
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb4 at pci0 dev 28 function 0 "Intel 6 Series PCIE" rev 0xb5: msi
pci5 at ppb4 bus 5
ppb5 at pci0 dev 28 function 4 "Intel 6 Series PCIE" rev 0xb5: msi
pci6 at ppb5 bus 6
ppb6 at pci0 dev 28 function 5 "Intel 6 Series PCIE" rev 0xb5: msi
pci7 at ppb6 bus 7
ehci1 at pci0 dev 29 function 0 "Intel 6 Series USB" rev 0x05: apic 2 int 23
usb1 at ehci1: USB revision 2.0
uhub1 at usb1 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb7 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0xa5
pci8 at ppb7 bus 8
vga1 at pci8 dev 3 function 0 "Matrox MGA G200eW" rev 0x0a
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
pcib0 at pci0 dev 31 function 0 "Intel C204 LPC" rev 0x05
ahci0 at pci0 dev 31 function 2 "Intel 6 Series AHCI" rev 0x05: msi,
AHCI 1.3
scsibus0 at ahci0: 32 targets
sd0 at scsibus0 targ 0 lun 0: <ATA, INTEL SSDSA2CT04, 4PC1> SCSI3
0/direct fixe
d naa.5001517972e5eafe
sd0: 38166MB, 512 bytes/sector, 78165360 sectors, thin
ichiic0 at pci0 dev 31 function 3 "Intel 6 Series SMBus" rev 0x05: apic
2 int 1
8
iic0 at ichiic0
sdtemp0 at iic0 addr 0x18: stts2002
sdtemp1 at iic0 addr 0x1a: stts2002
spdmem0 at iic0 addr 0x50: 1GB DDR3 SDRAM ECC PC3-10600 with thermal sensor
spdmem1 at iic0 addr 0x52: 1GB DDR3 SDRAM ECC PC3-10600 with thermal sensor
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com0: console
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
wbsio0 at isa0 port 0x2e/2: NCT6776F rev 0x33
lm1 at wbsio0 port 0xa30/8: NCT6776F
mtrr: Pentium Pro MTRR support
uhub2 at uhub0 port 1 "Intel Rate Matching Hub" rev 2.00/0.00 addr 2
uhidev0 at uhub2 port 2 configuration 1 interface 0 "Winbond Electronics
Corp H
ermon USB hidmouse Device" rev 1.10/0.01 addr 3
uhidev0: iclass 3/1
ums0 at uhidev0: 3 buttons, Z dir
wsmouse0 at ums0 mux 0
uhidev1 at uhub2 port 2 configuration 1 interface 1 "Winbond Electronics
Corp H
ermon USB hidmouse Device" rev 1.10/0.01 addr 3
uhidev1: iclass 3/1
ukbd0 at uhidev1: 8 variable keys, 6 key codes
wskbd1 at ukbd0 mux 1
wskbd1: connecting to wsdisplay0
uhub3 at uhub1 port 1 "Intel Rate Matching Hub" rev 2.00/0.00 addr 2
vscsi0 at root
scsibus1 at vscsi0: 256 targets
softraid0 at root
scsibus2 at softraid0: 256 targets
root on sd0a (7ff3d23b1c676904.a) swap on sd0b dump on sd0b
WARNING: / was not properly unmounted
bnx0: address 00:0a:f7:29:5c:78
brgphy0 at bnx0 phy 1: BCM5709 10/100/1000baseT PHY, rev. 8
bnx1: address 00:0a:f7:29:5c:7a
brgphy1 at bnx1 phy 1: BCM5709 10/100/1000baseT PHY, rev. 8
bnx2: address 00:0a:f7:29:5c:7c
brgphy2 at bnx2 phy 1: BCM5709 10/100/1000baseT PHY, rev. 8
bnx3: address 00:0a:f7:29:5c:7e
brgphy3 at bnx3 phy 1: BCM5709 10/100/1000baseT PHY, rev. 8
<3>carp: carp1006 demoted group carp by 1 to 129 (carpdev)
<3>carp: carp1020 demoted group carp by 1 to 130 (carpdev)
<3>carp: carp110 demoted group carp by 1 to 131 (carpdev)
<3>carp: carp111 demoted group carp by 1 to 132 (carpdev)
<3>carp: carp112 demoted group carp by 1 to 133 (carpdev)
<3>carp: carp2 demoted group carp by 1 to 134 (carpdev)
<3>carp: carp211 demoted group carp by 1 to 135 (carpdev)
<4>carp1006: state transition: INIT -> BACKUP
<3>carp: carp1006 demoted group carp by -1 to 134 (carpdev)
<4>carp1020: state transition: INIT -> BACKUP
<3>carp: carp1020 demoted group carp by -1 to 133 (carpdev)
<4>carp111: state transition: INIT -> BACKUP
<3>carp: carp111 demoted group carp by -1 to 132 (carpdev)
<4>carp112: state transition: INIT -> BACKUP
<3>carp: carp112 demoted group carp by -1 to 131 (carpdev)
<4>carp2: state transition: INIT -> BACKUP
<3>carp: carp2 demoted group carp by -1 to 130 (carpdev)
<4>carp211: state transition: INIT -> BACKUP
<3>carp: carp211 demoted group carp by -1 to 129 (carpdev)
<3>carp: pfsync0 demoted group carp by 32 to 161 (pfsync init)
<3>carp: pfsync0 demoted group pfsync by 32 to 32 (pfsync init)
<3>carp: pfsync0 demoted group carp by 1 to 162 (pfsync bulk start)
<3>carp: pfsync0 demoted group pfsync by 1 to 33 (pfsync bulk start)
<4>carp110: state transition: INIT -> BACKUP
<3>carp: carp110 demoted group carp by -1 to 161 (carpdev)
<2>carp1006: state transition: BACKUP -> MASTER
<2>carp1020: state transition: BACKUP -> MASTER
<2>carp111: state transition: BACKUP -> MASTER
<2>carp112: state transition: BACKUP -> MASTER
<2>carp2: state transition: BACKUP -> MASTER
<2>carp211: state transition: BACKUP -> MASTER
<2>carp110: state transition: BACKUP -> MASTER
<2>carp1006: state transition: MASTER -> BACKUP
<2>carp1020: state transition: MASTER -> BACKUP
<2>carp111: state transition: MASTER -> BACKUP
<2>carp112: state transition: MASTER -> BACKUP
<2>carp2: state transition: MASTER -> BACKUP
<2>carp211: state transition: MASTER -> BACKUP
<2>carp110: state transition: MASTER -> BACKUP
<3>carp: pfsync0 demoted group carp by -1 to 32 (pfsync bulk done)
<3>carp: pfsync0 demoted group pfsync by -1 to 32 (pfsync bulk done)
<3>carp: pfsync0 demoted group carp by -32 to 0 (pfsync init)
<3>carp: pfsync0 demoted group pfsync by -32 to 0 (pfsync init)
<2>carp110: state transition: BACKUP -> MASTER
<2>carp1006: state transition: BACKUP -> MASTER
<2>carp1020: state transition: BACKUP -> MASTER
<2>carp111: state transition: BACKUP -> MASTER
<2>carp112: state transition: BACKUP -> MASTER
<2>carp2: state transition: BACKUP -> MASTER
<2>carp211: state transition: BACKUP -> MASTER
<6>arp info overwritten for 172.16.20.29 by 00:0a:f7:29:5d:6a on vlan2
<6>arp info overwritten for 172.16.20.250 by 00:50:56:b3:3e:85 on vlan2
<6>arp info overwritten for 172.16.20.250 by 00:50:56:b3:3e:87 on vlan2
<6>arp info overwritten for 172.16.20.250 by 00:50:56:b3:3e:89 on vlan2
<3>pf: state key linking mismatch! dir=OUT, if=vlan111, stored af=2, a0:
0.0.0.
0:1166, a1: 185.29.153.19:445, proto=6, found af=2, a0:
185.29.153.19:445, a1: 1
85.29.153.2:1166, proto=6
<3>pf: state key linking mismatch! dir=OUT, if=vlan111, stored af=2, a0:
0.0.0.
0:4726, a1: 185.29.153.89:445, proto=6, found af=2, a0:
185.29.153.89:445, a1: 1
85.29.153.2:4726, proto=6
<3>pf: state key linking mismatch! dir=OUT, if=vlan111, stored af=2, a0:
0.0.0.
0:4376, a1: 185.29.153.38:445, proto=6, found af=2, a0:
185.29.153.38:445, a1: 1
85.29.153.2:4376, proto=6
<3>pf: state key linking mismatch! dir=OUT, if=vlan111, stored af=2, a0:
0.0.0.
0:2052, a1: 185.29.153.120:445, proto=6, found af=2, a0:
185.29.153.120:445, a1
: 185.29.153.2:2052, proto=6
mode = 0100644, inum = 415786, fs = /var
panic: ffs_valloc: dup alloc
Stopped at Debugger+0x5: leave
RUN AT LEAST 'trace' AND 'ps' AND INCLUDE OUTPUT WHEN REPORTING THIS PANIC!
IF RUNNING SMP, USE 'mach ddbcpu <#>' AND 'trace' ON OTHER PROCESSORS, TOO.
DO NOT EVEN BOTHER REPORTING THIS WITHOUT INCLUDING THAT INFORMATION!
ddb{0}> ddb{0}> Debugger() at Debugger+0x5
panic() at panic+0xe4
ffs1_reallocblks() at ffs1_reallocblks
ufs_makeinode() at ufs_makeinode+0x88
ufs_create() at ufs_create+0x35
VOP_CREATE() at VOP_CREATE+0x30
vn_open() at vn_open+0x2ad
doopenat() at doopenat+0x125
syscall() at syscall+0x249
--- syscall (number 5) ---
end of kernel
end trace frame: 0x8, count: -9
0x20f95f1ca:
