On Thu, May 15, 2008 at 2:00 PM, Darrian Hale <[EMAIL PROTECTED]> wrote:
> What output to you get from 'netstat -m'?
2867 mbufs in use:
2566 mbufs allocated to data
274 mbufs allocated to packet headers
27 mbufs allocated to socket names and addresses
1129/5450/6144 mbuf clusters in use (current/peak/max)
13028 Kbytes allocated to network (22% in use)
0 requests for memory denied
0 requests for memory delayed
0 calls to protocol drain routines
> I might get yelled at for this as you mentioned people seem to hate
> custom kernels.
>
> But i've had good luck with the following options, I'm not sure which
> are still relevant, but they help.
>
> option NKMEMPAGES_MAX=81920
> option NKMEMPAGES=81920
> option MAX_KMAPENT=8192
>
> I've always received that error you described on any high load openbsd
> box. Even with the above changes,
> you will eventually get the same error as your new limits are reached.
>
> If you come up with any better solutions, please let me know, i'd be
> very interested to hear them.
>
> -Darrian
>
> On Thu, May 15, 2008 at 10:29 AM, Kevin <[EMAIL PROTECTED]> wrote:
>> All,
>>
>> I'm getting quite a lot of these errors in /var/log/messages and can't
>> seem to find an appropriate fix in the archives:
>>
>> May 14 21:05:54 svr02 /bsd: uvm_mapent_alloc: out of static map entries
>> May 14 21:57:47 svr02 /bsd: uvm_mapent_alloc: out of static map entries
>> May 14 23:00:05 svr02 /bsd: uvm_mapent_alloc: out of static map entries
>> May 15 07:27:53 svr02 /bsd: uvm_mapent_alloc: out of static map entries
>> May 15 07:39:59 svr02 /bsd: uvm_mapent_alloc: out of static map entries
>>
>> N.B. This machine serves mirror content for various F/OSS projects in
>> addition to standard www content, so it quite often has >350 users
>> concurrently connected downloading mirrored content (in addition to
>> visitors who're actually visiting the site).
>>
>>
>> These messages correspond almost exactly with two things:
>>
>> 1.) the sites having quite a few visitors
>> 2.) the sites becoming unavailable. In most cases, it fixes itself
>> when the freeloaders (errr downloaders ;-) complete their file
>> transfers.
>>
>>
>> Possibly worth noting:
>>
>> 1.) We've had to crank various settings in Apache to keep serving
>> traffic, as the stock settings were too low: we were reaching the max
>> daemons for Apache so new visitors were just out-of-luck.
>> 2.) When the system begins to knuckle under load, I'm taking a
>> snapshot of various bits like the following.
>>
>> Here's one example:
>> load averages: 0.45, 0.47, 0.40 07:40:00
>> 247 processes: 245 idle, 2 on processor
>> CPU0 states: 7.2% user, 0.0% nice, 2.6% system, 2.2% interrupt, 88.0%
>> idle
>> CPU1 states: 3.6% user, 0.0% nice, 0.3% system, 1.9% interrupt, 94.3%
>> idle
>> Memory: Real: 339M/737M act/tot Free: 1272M Swap: 0K/518M used/tot
>>
>>
>> From the archives this seems to be something for which a fix *used* to
>> be cranking up the following:
>>
>> maxusers 64
>> option BUFCACHEPERCENT=25
>> option MULTIPROCESSOR
>> option MAX_KMAPENT=4000
>>
>>
>> This hardly seems a real fix though--especially given everyone's
>> hatred of knobs, custom kernels, and such though I'm certainly open to
>> it if we can continue to keep the sites--and the mirrors--up.
>>
>> I think I've mentioned everything noteworthy though cluestick
>> applications are welcome.
>>
>> Thanks,
>> Kevin
>>
>>
>>
>>
>> Here's the dmesg for any interested parties:
>>
>>
>> OpenBSD 4.3 (GENERIC.MP) #2: Fri Apr 11 09:00:02 PDT 2008
>> [EMAIL PROTECTED]:/usr/src/sys/arch/i386/compile/GENERIC.MP
>> cpu0: Intel(R) Pentium(R) III CPU family 1266MHz ("GenuineIntel"
>> 686-class) 1.27 GHz
>> cpu0:
>> FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE
>> real mem = 2146992128 (2047MB)
>> avail mem = 2067959808 (1972MB)
>> mainbus0 at root
>> bios0 at mainbus0: AT/286+ BIOS, date 01/25/02, BIOS32 rev. 0 @
>> 0xffe90, SMBIOS rev. 2.3 @ 0xfae20 (49 entries)
>> bios0: vendor Dell Computer Corporation version "A06" date 01/25/2002
>> bios0: Dell Computer Corporation PowerEdge 2550
>> acpi0 at bios0: rev 0
>> acpi0: tables DSDT FACP APIC SPCR
>> acpi0: wakeup devices PCI1(S5) PCI2(S5) PCI0(S5)
>> acpitimer0 at acpi0: 3579545 Hz, 32 bits
>> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
>> cpu0 at mainbus0: apid 1 (boot processor)
>> cpu0: apic clock running at 132MHz
>> cpu1 at mainbus0: apid 0 (application processor)
>> cpu1: Intel(R) Pentium(R) III CPU family 1266MHz ("GenuineIntel"
>> 686-class) 1.27 GHz
>> cpu1:
>> FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE
>> ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 11, 16 pins
>> ioapic0: misconfigured as apic 0, remapped to apid 2
>> ioapic1 at mainbus0: apid 3 pa 0xfec01000, version 11, 16 pins
>> ioapic1: misconfigured as apic 0, remapped to apid 3
>> acpiprt0 at acpi0: bus 0 (PCI1)
>> acpiprt1 at acpi0: bus 1 (PCI2)
>> acpiprt2 at acpi0: bus 2 (PCI0)
>> acpiprt3 at acpi0: bus 3 (I960)
>> acpicpu0 at acpi0
>> acpicpu1 at acpi0
>> bios0: ROM list: 0xc0000/0x8000 0xcc000/0x8000 0xec000/0x4000!
>> esm0 at mainbus0
>> esm0: PowerEdge 2550 Embedded Server Management 5.50
>> esm0: Primary System Backplane 1.30
>> pci0 at mainbus0 bus 0: configuration mode 1 (no bios)
>> pchb0 at pci0 dev 0 function 0 "ServerWorks CNB20HE Host" rev 0x23
>> pchb1 at pci0 dev 0 function 1 "ServerWorks CNB20HE Host" rev 0x01
>> pci1 at pchb1 bus 2
>> ppb0 at pci1 dev 2 function 0 "Intel i960 RM PCI-PCI" rev 0x02
>> pci2 at ppb0 bus 3
>> ahc0 at pci2 dev 4 function 0 "Adaptec AIC-7899 U160" rev 0x01: apic 3
>> int 15 (irq 11)
>> scsibus0 at ahc0: 16 targets
>> ahc1 at pci2 dev 4 function 1 "Adaptec AIC-7899 U160" rev 0x01: apic 3
>> int 14 (irq 10)
>> scsibus1 at ahc1: 16 targets
>> fxp0 at pci1 dev 4 function 0 "Intel 8255x" rev 0x08, i82559: apic 3
>> int 0 (irq 5), address 00:06:5b:3b:61:27
>> inphy0 at fxp0 phy 1: i82555 10/100 PHY, rev. 4
>> pchb2 at pci0 dev 0 function 2 "ServerWorks CNB20HE Host" rev 0x01
>> pchb3 at pci0 dev 0 function 3 "ServerWorks CNB20HE Host" rev 0x01
>> pci3 at pchb3 bus 1
>> bge0 at pci3 dev 8 function 0 "Broadcom BCM5700" rev 0x12, BCM5700 B2
>> (0x7102): apic 3 int 1 (irq 10), address 00:06:5b:3b:61:28
>> brgphy0 at bge0 phy 1: BCM5401 10/100/1000baseT PHY, rev. 3
>> gdt0 at pci0 dev 4 function 0 "Vortex GDT6x18RD" rev 0x00: apic 3 int
>> 6 (irq 11) dpmem c8000 2-bus 2 cache devices
>> gdt0: ver 11a, cache on, strategy 2, writeback on, blksz 32
>> gdt0: raw feat 1 cache feat 101
>> scsibus2 at gdt0: 35 targets
>> sd0 at scsibus2 targ 0 lun 0: <ICP, Host drive #00, > SCSI2 0/direct fixed
>> sd0: 35000MB, 4462 cyl, 255 head, 63 sec, 512 bytes/sec, 71682030 sec total
>> sd1 at scsibus2 targ 1 lun 0: <ICP, Host drive #01, > SCSI2 0/direct fixed
>> sd1: 140200MB, 17873 cyl, 255 head, 63 sec, 512 bytes/sec, 287129745 sec
>> total
>> scsibus3 at gdt0: 16 targets
>> scsibus4 at gdt0: 16 targets
>> vga1 at pci0 dev 14 function 0 "ATI Rage XL" rev 0x27
>> wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
>> wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
>> piixpm0 at pci0 dev 15 function 0 "ServerWorks OSB4" rev 0x50: SMBus disabled
>> pciide0 at pci0 dev 15 function 1 "ServerWorks OSB4 IDE" rev 0x00: DMA
>> atapiscsi0 at pciide0 channel 0 drive 0
>> scsibus5 at atapiscsi0: 2 targets
>> cd0 at scsibus5 targ 0 lun 0: <TEAC, CD-224E, 3.7D> SCSI0 5/cdrom removable
>> cd0(pciide0:0:0): using PIO mode 4, DMA mode 2, Ultra-DMA mode 2
>> isa0 at mainbus0
>> isadma0 at isa0
>> pckbc0 at isa0 port 0x60/5
>> pckbd0 at pckbc0 (kbd slot)
>> pckbc0: using irq 1 for kbd slot
>> wskbd0 at pckbd0: console keyboard, using wsdisplay0
>> pcppi0 at isa0 port 0x61
>> midi0 at pcppi0: <PC speaker>
>> spkr0 at pcppi0
>> lpt0 at isa0 port 0x378/4 irq 7
>> npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16
>> pccom0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
>> pccom1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
>> fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
>> fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec
>> mtrr: Pentium Pro MTRR support
>> softraid0 at root
>> root on sd0a swap on sd0b dump on sd0b
