Sorry for delayed answer, I did both before: show uvmexp
https://www.dropbox.com/sh/dwmjt7wwunhk5gb/AABTdTS98GLF2vRN56mn6knpa/Screen%20Shot%202015-04-02%20at%2011.37.20.png?dl=0 https://www.dropbox.com/sh/dwmjt7wwunhk5gb/AAAPsq3yPHI3w5u_-ViB-Elva/Screen%20Shot%202015-04-02%20at%2011.37.27.png?dl=0 show all pools: https://www.dropbox.com/sh/dwmjt7wwunhk5gb/AAAbYVDgpH89Rh_g4Jl5ONOga/Screen%20Shot%202015-04-02%20at%2011.47.08.png?dl=0 https://www.dropbox.com/sh/dwmjt7wwunhk5gb/AACi9B7jT2gbmr1YQWKQeYRpa/Screen%20Shot%202015-04-02%20at%2011.47.14.png?dl=0 https://www.dropbox.com/sh/dwmjt7wwunhk5gb/AACi9B7jT2gbmr1YQWKQeYRpa/Screen%20Shot%202015-04-02%20at%2011.47.14.png?dl=0 https://www.dropbox.com/sh/dwmjt7wwunhk5gb/AAA62XYFUPFAZ37vVdiDpsm-a/Screen%20Shot%202015-04-02%20at%2011.47.20.png?dl=0 https://www.dropbox.com/sh/dwmjt7wwunhk5gb/AAD2K3pLsAqORiknjPaFHz3sa/Screen%20Shot%202015-04-02%20at%2011.47.52.png?dl=0 I had to restart server because I'm afraid that second (same hw) can do same panic. On Thu, Apr 2, 2015 at 3:04 PM, Mark Kettenis <mark.kette...@xs4all.nl> wrote: >> Date: Thu, 2 Apr 2015 13:16:12 +0200 >> From: Evgeniy Sudyr <eject.in...@gmail.com> >> >> Hi all, >> >> On -stable with patches installed on Supermicro server, got Panic: >> malloc: out of space in kmem_map. >> >> This is first time this panic happened. >> >> On this server haproxy and bgpd were running where haproxy was running >> under high load ± 3.5 before failure. >> >> Sorry, but I have no access to serial console, only way I can get ddb >> is KVM console. >> >> I've placed them all there >> https://www.dropbox.com/sh/dwmjt7wwunhk5gb/AABaNT5RwqLyggWlbGxOIgqPa?dl=0 >> >> This is dmesg: >> >> OpenBSD 5.6-stable (GENERIC.MP) #0: Thu Feb 12 16:16:18 EET 2015 >> root@router1-test:/usr/src/sys/arch/amd64/compile/GENERIC.MP >> real mem = 17128275968 (16334MB) >> avail mem = 16663535616 (15891MB) >> mpath0 at root >> scsibus0 at mpath0: 256 targets >> mainbus0 at root >> bios0 at mainbus0: SMBIOS rev. 2.7 @ 0xec640 (131 entries) >> bios0: vendor American Megatrends Inc. version "3.00" date 07/05/2013 >> bios0: Supermicro X9SRW-F >> acpi0 at bios0: rev 2 >> acpi0: sleep states S0 S1 S4 S5 >> acpi0: tables DSDT FACP APIC FPDT HPET PRAD SPMI SSDT EINJ ERST HEST >> BERT DMAR MCFG >> acpi0: wakeup devices P0P9(S1) EUSB(S4) USBE(S4) PEX0(S4) PWVE(S4) >> PEX1(S4) PEX2(S4) PEX3(S4) PEX4(S4) PEX5(S4) PEX6(S4) PEX7(S4) >> NPE1(S4) NPE2(S4) NPE3(S4) NPE4(S4) [...] >> acpitimer0 at acpi0: 3579545 Hz, 24 bits >> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat >> cpu0 at mainbus0: apid 0 (boot processor) >> cpu0: Intel(R) Xeon(R) CPU E5-2609 v2 @ 2.50GHz, 2500.42 MHz >> cpu0: >> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS >> cpu0: 256KB 64b/line 8-way L2 cache >> cpu0: smt 0, core 0, package 0 >> mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges >> cpu0: apic clock running at 99MHz >> cpu0: mwait min=64, max=64, C-substates=0.2.1.1.0, IBE >> cpu1 at mainbus0: apid 2 (application processor) >> cpu1: Intel(R) Xeon(R) CPU E5-2609 v2 @ 2.50GHz, 2499.99 MHz >> cpu1: >> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS >> cpu1: 256KB 64b/line 8-way L2 cache >> cpu1: smt 0, core 1, package 0 >> cpu2 at mainbus0: apid 4 (application processor) >> cpu2: Intel(R) Xeon(R) CPU E5-2609 v2 @ 2.50GHz, 2500.00 MHz >> cpu2: >> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS >> cpu2: 256KB 64b/line 8-way L2 cache >> cpu2: smt 0, core 2, package 0 >> cpu3 at mainbus0: apid 6 (application processor) >> cpu3: Intel(R) Xeon(R) CPU E5-2609 v2 @ 2.50GHz, 2500.00 MHz >> cpu3: >> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS >> cpu3: 256KB 64b/line 8-way L2 cache >> cpu3: smt 0, core 3, package 0 >> ioapic0 at mainbus0: apid 0 pa 0xfec00000, version 20, 24 pins >> ioapic1 at mainbus0: apid 2 pa 0xfec01000, version 20, 24 pins >> acpihpet0 at acpi0: 14318179 Hz >> acpimcfg0 at acpi0 addr 0x80000000, bus 0-255 >> acpiprt0 at acpi0: bus 0 (PCI0) >> acpiprt1 at acpi0: bus 9 (P0P9) >> acpiprt2 at acpi0: bus 7 (PEX0) >> acpiprt3 at acpi0: bus -1 (PEX1) >> acpiprt4 at acpi0: bus -1 (PEX2) >> acpiprt5 at acpi0: bus -1 (PEX3) >> acpiprt6 at acpi0: bus -1 (PEX4) >> acpiprt7 at acpi0: bus -1 (PEX5) >> acpiprt8 at acpi0: bus -1 (PEX6) >> acpiprt9 at acpi0: bus -1 (PEX7) >> acpiprt10 at acpi0: bus 6 (P0PA) >> acpiprt11 at acpi0: bus 1 (NPE1) >> acpiprt12 at acpi0: bus -1 (NPE2) >> acpiprt13 at acpi0: bus 3 (NPE3) >> acpiprt14 at acpi0: bus -1 (NPE4) >> acpiprt15 at acpi0: bus -1 (NPE5) >> acpiprt16 at acpi0: bus -1 (NPE6) >> acpiprt17 at acpi0: bus 4 (NPE7) >> acpiprt18 at acpi0: bus -1 (NPE8) >> acpiprt19 at acpi0: bus -1 (NPE9) >> acpiprt20 at acpi0: bus -1 (NPEA) >> acpicpu0 at acpi0: C2, C1, PSS >> acpicpu1 at acpi0: C2, C1, PSS >> acpicpu2 at acpi0: C2, C1, PSS >> acpicpu3 at acpi0: C2, C1, PSS >> acpibtn0 at acpi0: SLPB >> acpibtn1 at acpi0: PWRB >> ipmi at mainbus0 not configured >> cpu0: Enhanced SpeedStep 2500 MHz: speeds: 2500, 2400, 2300, 2200, >> 2100, 2000, 1900, 1800, 1700, 1600, 1500, 1400, 1300, 1200 MHz >> pci0 at mainbus0 bus 0 >> pchb0 at pci0 dev 0 function 0 "Intel E5 v2 Host" rev 0x04 >> ppb0 at pci0 dev 1 function 0 "Intel E5 v2 PCIE" rev 0x04: msi >> pci1 at ppb0 bus 1 >> em0 at pci1 dev 0 function 0 "Intel I350" rev 0x01: msi, address >> a0:36:9f:54:73:78 >> em1 at pci1 dev 0 function 1 "Intel I350" rev 0x01: msi, address >> a0:36:9f:54:73:79 >> em2 at pci1 dev 0 function 2 "Intel I350" rev 0x01: msi, address >> a0:36:9f:54:73:7a >> em3 at pci1 dev 0 function 3 "Intel I350" rev 0x01: msi, address >> a0:36:9f:54:73:7b >> ppb1 at pci0 dev 2 function 0 "Intel E5 v2 PCIE" rev 0x04: msi >> pci2 at ppb1 bus 3 >> ppb2 at pci0 dev 3 function 0 "Intel E5 v2 PCIE" rev 0x04: msi >> pci3 at ppb2 bus 4 >> em4 at pci3 dev 0 function 0 "Intel I350" rev 0x01: msi, address >> a0:36:9f:54:73:6c >> em5 at pci3 dev 0 function 1 "Intel I350" rev 0x01: msi, address >> a0:36:9f:54:73:6d >> em6 at pci3 dev 0 function 2 "Intel I350" rev 0x01: msi, address >> a0:36:9f:54:73:6e >> em7 at pci3 dev 0 function 3 "Intel I350" rev 0x01: msi, address >> a0:36:9f:54:73:6f >> "Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 0 not configured >> "Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 1 not configured >> "Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 2 not configured >> "Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 3 not configured >> "Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 4 not configured >> "Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 5 not configured >> "Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 6 not configured >> "Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 7 not configured >> vendor "Intel", unknown product 0x0e28 (class system subclass >> miscellaneous, rev 0x04) at pci0 dev 5 function 0 not configured >> "Intel E5 v2 IIO RAS" rev 0x04 at pci0 dev 5 function 2 not configured >> vendor "Intel", unknown product 0x0e2c (class system subclass >> interrupt, rev 0x04) at pci0 dev 5 function 4 not configured >> ppb3 at pci0 dev 17 function 0 "Intel C600 Virtual PCIE" rev 0x06 >> pci4 at ppb3 bus 6 >> vendor "Intel", unknown product 0x1d6b (class mass storage subclass >> SAS, rev 0x06) at pci4 dev 0 function 0 not configured >> "Intel C600 MEI" rev 0x05 at pci0 dev 22 function 0 not configured >> "Intel C600 MEI" rev 0x05 at pci0 dev 22 function 1 not configured >> ehci0 at pci0 dev 26 function 0 "Intel C600 USB" rev 0x06: apic 0 int 16 >> usb0 at ehci0: USB revision 2.0 >> uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1 >> ppb4 at pci0 dev 28 function 0 "Intel C600 PCIE" rev 0xb6: msi >> pci5 at ppb4 bus 7 >> em8 at pci5 dev 0 function 0 "Intel I350" rev 0x01: msi, address >> 0c:c4:7a:0a:24:64 >> em9 at pci5 dev 0 function 1 "Intel I350" rev 0x01: msi, address >> 0c:c4:7a:0a:24:65 >> ehci1 at pci0 dev 29 function 0 "Intel C600 USB" rev 0x06: apic 0 int 23 >> usb1 at ehci1: USB revision 2.0 >> uhub1 at usb1 "Intel EHCI root hub" rev 2.00/1.00 addr 1 >> ppb5 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0xa6 >> pci6 at ppb5 bus 9 >> vga1 at pci6 dev 4 function 0 "Matrox MGA G200eW" rev 0x0a >> wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) >> wsdisplay0: screen 1-5 added (80x25, vt100 emulation) >> pcib0 at pci0 dev 31 function 0 "Intel C600 LPC" rev 0x06 >> ahci0 at pci0 dev 31 function 2 "Intel C600 AHCI" rev 0x06: msi, AHCI 1.3 >> scsibus1 at ahci0: 32 targets >> sd0 at scsibus1 targ 0 lun 0: <ATA, WDC WD5003ABYZ-0, 01.0> SCSI3 >> 0/direct fixed naa.50014ee059432578 >> sd0: 476940MB, 512 bytes/sector, 976773168 sectors >> sd1 at scsibus1 targ 1 lun 0: <ATA, WDC WD5003ABYZ-0, 01.0> SCSI3 >> 0/direct fixed naa.50014ee0ae98bd4c >> sd1: 476940MB, 512 bytes/sector, 976773168 sectors >> ichiic0 at pci0 dev 31 function 3 "Intel C600 SMBus" rev 0x06: apic 0 int 18 >> iic0 at ichiic0 >> "Intel C600 Thermal" rev 0x06 at pci0 dev 31 function 6 not configured >> isa0 at pcib0 >> isadma0 at isa0 >> com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo >> com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo >> pckbc0 at isa0 port 0x60/5 >> pcppi0 at isa0 port 0x61 >> spkr0 at pcppi0 >> pci7 at mainbus0 bus 255 >> "Intel E5 v2 QPI Link" rev 0x04 at pci7 dev 8 function 0 not configured >> "Intel E5 v2 QPI Link" rev 0x04 at pci7 dev 9 function 0 not configured >> "Intel E5 v2 PCU" rev 0x04 at pci7 dev 10 function 0 not configured >> "Intel E5 v2 PCU" rev 0x04 at pci7 dev 10 function 1 not configured >> "Intel E5 v2 PCU" rev 0x04 at pci7 dev 10 function 2 not configured >> "Intel E5 v2 PCU" rev 0x04 at pci7 dev 10 function 3 not configured >> "Intel E5 v2 UBOX" rev 0x04 at pci7 dev 11 function 0 not configured >> "Intel E5 v2 UBOX" rev 0x04 at pci7 dev 11 function 3 not configured >> "Intel E5 v2 Unicast" rev 0x04 at pci7 dev 12 function 0 not configured >> "Intel E5 v2 Unicast" rev 0x04 at pci7 dev 12 function 1 not configured >> "Intel E5 v2 Unicast" rev 0x04 at pci7 dev 13 function 0 not configured >> "Intel E5 v2 Unicast" rev 0x04 at pci7 dev 13 function 1 not configured >> "Intel E5 v2 Home Agent" rev 0x04 at pci7 dev 14 function 0 not configured >> "Intel E5 v2 Home Agent" rev 0x04 at pci7 dev 14 function 1 not configured >> "Intel E5 v2 TA" rev 0x04 at pci7 dev 15 function 0 not configured >> "Intel E5 v2 RAS" rev 0x04 at pci7 dev 15 function 1 not configured >> "Intel E5 v2 TAD" rev 0x04 at pci7 dev 15 function 2 not configured >> "Intel E5 v2 TAD" rev 0x04 at pci7 dev 15 function 3 not configured >> "Intel E5 v2 TAD" rev 0x04 at pci7 dev 15 function 4 not configured >> "Intel E5 v2 TAD" rev 0x04 at pci7 dev 15 function 5 not configured >> "Intel E5 v2 Thermal" rev 0x04 at pci7 dev 16 function 0 not configured >> "Intel E5 v2 Thermal" rev 0x04 at pci7 dev 16 function 1 not configured >> "Intel E5 v2 Error" rev 0x04 at pci7 dev 16 function 2 not configured >> vendor "Intel", unknown product 0x0eb3 (class system subclass >> miscellaneous, rev 0x04) at pci7 dev 16 function 3 not configured >> "Intel E5 v2 Thermal" rev 0x04 at pci7 dev 16 function 4 not configured >> "Intel E5 v2 Thermal" rev 0x04 at pci7 dev 16 function 5 not configured >> vendor "Intel", unknown product 0x0eb6 (class system subclass >> miscellaneous, rev 0x04) at pci7 dev 16 function 6 not configured >> vendor "Intel", unknown product 0x0eb7 (class system subclass >> miscellaneous, rev 0x04) at pci7 dev 16 function 7 not configured >> vendor "Intel", unknown product 0x0e1d (class system subclass >> miscellaneous, rev 0x04) at pci7 dev 19 function 0 not configured >> "Intel E5 v2 QPI Link Monitor" rev 0x04 at pci7 dev 19 function 1 not >> configured >> "Intel E5 v2 QPI" rev 0x04 at pci7 dev 19 function 4 not configured >> "Intel E5 v2 QPI Link Monitor" rev 0x04 at pci7 dev 19 function 5 not >> configured >> "Intel E5 v2 SAD" rev 0x04 at pci7 dev 22 function 0 not configured >> "Intel E5 v2 Broadcast" rev 0x04 at pci7 dev 22 function 1 not configured >> "Intel E5 v2 Broadcast" rev 0x04 at pci7 dev 22 function 2 not configured >> uhub2 at uhub0 port 1 "Intel Rate Matching Hub" rev 2.00/0.00 addr 2 >> uhidev0 at uhub2 port 5 configuration 1 interface 0 "Winbond >> Electronics Corp Hermon USB hidmouse Device" rev 1.10/0.01 addr 3 >> uhidev0: iclass 3/1 >> ums0 at uhidev0: 3 buttons, Z dir >> wsmouse0 at ums0 mux 0 >> uhidev1 at uhub2 port 5 configuration 1 interface 1 "Winbond >> Electronics Corp Hermon USB hidmouse Device" rev 1.10/0.01 addr 3 >> uhidev1: iclass 3/1 >> ukbd0 at uhidev1: 8 variable keys, 6 key codes >> wskbd0 at ukbd0: console keyboard, using wsdisplay0 >> uhub3 at uhub1 port 1 "Intel Rate Matching Hub" rev 2.00/0.00 addr 2 >> vscsi0 at root >> scsibus2 at vscsi0: 256 targets >> softraid0 at root >> scsibus3 at softraid0: 256 targets >> root on sd0a (8d85105cf052fe43.a) swap on sd0b dump on sd0b >> >> I didn't restarted server and can get more details from ddb if needed. > > Output of "show uvmexp" and "show all pools" could help us diagnose > the problem. -- -- With regards, Eugene Sudyr
