Michael, I just upgraded my box to 5.8, and, for my surprise the CPU usage was
worst... I was able to use 100% of the cpu0 and the latency started to increase.
Here is my dmesg output:
OpenBSD 5.8 (GENERIC.MP) #1236: Sun Aug 16 02:31:04 MDT 2015
dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MPreal mem =
8559443968 (8162MB)avail mem = 8296136704 (7911MB)mpath0 at rootscsibus0 at
mpath0: 256 targetsmainbus0 at rootbios0 at mainbus0: SMBIOS rev. 2.8 @
0x7f525000 (53 entries)bios0: vendor American Megatrends Inc. version "5.6.5"
date 08/26/2014acpi0 at bios0: rev 2acpi0: sleep states S0 S5acpi0: tables DSDT
FACP FPDT MCFG WDAT UEFI APIC BDAT HPET SSDT SPCR HEST BERT E
RST EINJacpi0: wakeup devices SIO1(S0) PEX1(S0) PEX2(S0)
PEX3(S0) PEX4(S0) EHC1(S0)acpitimer0 at acpi0: 3579545 Hz, 24 bitsacpimcfg0 at
acpi0 addr 0xe0000000, bus 0-255acpimadt0 at acpi0 addr 0xfee00000: PC-AT
compatcpu0 at mainbus0: apid 0 (boot processor)cpu0: Intel(R) Atom(TM) CPU
C2758 @ 2.41GHz, 2417.11 MHzcpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CF
LUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX
,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,MOVBE,POPCNT,DEADLINE,AES,RDRAND,NXE
,LONG,LAHF,3DNOWP,PERF,ITSC,SMEP,ERMS,SENSOR,ARATcpu0: 1MB 64b/line 16-way L2
cachecpu0: smt 0, core 0, package 0mtrr: Pentium Pro MTRR support, 8 var
ranges, 88 fixed rangescpu0: apic clock running at 83MHzcpu0: mwait min=64,
max=64, C-substates=0.2.0.0.0.0.3, IBEcpu1 at mainbus0: apid 2 (application
processor)cpu1: Intel(R) Atom(TM) CPU C2758 @ 2.41GHz, 2416.67 MHzcpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CF
LUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX
,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,MOVBE,POPCNT,DEADLINE,AES,RDRAND,NXE
,LONG,LAHF,3DNOWP,PERF,ITSC,SMEP,ERMS,SENSOR,ARATcpu1: 1MB 64b/line 16-way L2
cachecpu1: smt 0, core 1, package 0cpu2 at mainbus0: apid 4 (application
processor)cpu2: Intel(R) Atom(TM) CPU C2758 @ 2.41GHz, 2416.67 MHzcpu2:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CF
LUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX
,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,MOVBE,POPCNT,DEADLINE,AES,RDRAND,NXE
,LONG,LAHF,3DNOWP,PERF,ITSC,SMEP,ERMS,SENSOR,ARATcpu2: 1MB 64b/line 16-way L2
cachecpu2: smt 0, core 2, package 0cpu3 at mainbus0: apid 6 (application
processor)cpu3: Intel(R) Atom(TM) CPU C2758 @ 2.41GHz, 2416.67 MHzcpu3:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CF
LUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX
,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,MOVBE,POPCNT,DEADLINE,AES,RDRAND,NXE
,LONG,LAHF,3DNOWP,PERF,ITSC,SMEP,ERMS,SENSOR,ARATcpu3: 1MB 64b/line 16-way L2
cachecpu3: smt 0, core 3, package 0cpu4 at mainbus0: apid 8 (application
processor)cpu4: Intel(R) Atom(TM) CPU C2758 @ 2.41GHz, 2416.67 MHzcpu4:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CF
LUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX
,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,MOVBE,POPCNT,DEADLINE,AES,RDRAND,NXE
,LONG,LAHF,3DNOWP,PERF,ITSC,SMEP,ERMS,SENSOR,ARATcpu4: 1MB 64b/line 16-way L2
cachecpu4: smt 0, core 4, package 0cpu5 at mainbus0: apid 10 (application
processor)cpu5: Intel(R) Atom(TM) CPU C2758 @ 2.41GHz, 2416.67 MHzcpu5:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CF
LUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX
,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,MOVBE,POPCNT,DEADLINE,AES,RDRAND,NXE
,LONG,LAHF,3DNOWP,PERF,ITSC,SMEP,ERMS,SENSOR,ARATcpu5: 1MB 64b/line 16-way L2
cachecpu5: smt 0, core 5, package 0cpu6 at mainbus0: apid 12 (application
processor)cpu6: Intel(R) Atom(TM) CPU C2758 @ 2.41GHz, 2416.67 MHzcpu6:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CF
LUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX
,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,MOVBE,POPCNT,DEADLINE,AES,RDRAND,NXE
,LONG,LAHF,3DNOWP,PERF,ITSC,SMEP,ERMS,SENSOR,ARATcpu6: 1MB 64b/line 16-way L2
cachecpu6: smt 0, core 6, package 0cpu7 at mainbus0: apid 14 (application
processor)cpu7: Intel(R) Atom(TM) CPU C2758 @ 2.41GHz, 2416.67 MHzcpu7:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CF
LUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX
,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,MOVBE,POPCNT,DEADLINE,AES,RDRAND,NXE
,LONG,LAHF,3DNOWP,PERF,ITSC,SMEP,ERMS,SENSOR,ARATcpu7: 1MB 64b/line 16-way L2
cachecpu7: smt 0, core 7, package 0ioapic0 at mainbus0: apid 2 pa 0xfec00000,
version 20, 24 pinsacpihpet0 at acpi0: 14318179 Hzacpiprt0 at acpi0: bus 0
(PCI0)acpiprt1 at acpi0: bus 1 (PEX1)acpiprt2 at acpi0: bus 2 (PEX2)acpiprt3 at
acpi0: bus 3 (PEX3)acpiprt4 at acpi0: bus 4 (PEX4)acpicpu0 at acpi0: C1(@1
halt!)acpicpu1 at acpi0: C1(@1 halt!)acpicpu2 at acpi0: C1(@1 halt!)acpicpu3 at
acpi0: C1(@1 halt!)acpicpu4 at acpi0: C1(@1 halt!)acpicpu5 at acpi0: C1(@1
halt!)acpicpu6 at acpi0: C1(@1 halt!)acpicpu7 at acpi0: C1(@1 halt!)pci0 at
mainbus0 bus 0pchb0 at pci0 dev 0 function 0 "Intel Atom C2000 Host" rev
0x02ppb0 at pci0 dev 1 function 0 "Intel Atom C2000 PCIE" rev 0x02: msipci1 at
ppb0 bus 1em0 at pci1 dev 0 function 0 "Intel I210" rev 0x03: msi, address
84:44:64:fd:bd:
41ppb1 at pci0 dev 2
function 0 "Intel Atom C2000 PCIE" rev 0x02: msipci2 at ppb1 bus 2em1 at pci2
dev 0 function 0 "Intel I210" rev 0x03: msi, address 84:44:64:fb:9d:
a8ppb2 at pci0 dev 3 function 0 "Intel Atom C2000
PCIE" rev 0x02: msipci3 at ppb2 bus 3ppb3 at pci0 dev 4 function 0 "Intel Atom
C2000 PCIE" rev 0x02: msipci4 at ppb3 bus 4vendor "Intel", unknown product
0x1f18 (class processor subclass Co-processor, r
ev 0x02) at pci0 dev 11 function 0 not configuredpchb1 at pci0 dev 14
function 0 "Intel Atom C2000 RAS" rev 0x02"Intel Atom C2000 RCEC" rev 0x02 at
pci0 dev 15 function 0 not configured"Intel Atom C2000 SMBus" rev 0x02 at pci0
dev 19 function 0 not configuredem2 at pci0 dev 20 function 0 "Intel I354
SGMII" rev 0x03: msi, address 84:44:64
:a0:7c:e9em3 at pci0 dev 20 function 1 "Intel I354 SGMII" rev 0x03: msi,
address 84:44:64
:49:e6:68em4 at pci0 dev
20 function 2 "Intel I354 SGMII" rev 0x03: msi, address 84:44:64
:e7:e6:aaem5 at pci0 dev 20 function 3 "Intel I354 SGMII"
rev 0x03: msi, address 84:44:64
:06:ac:48ehci0 at pci0 dev 22 function 0 "Intel Atom C2000 USB" rev 0x02: apic
2 int 23usb0 at ehci0: USB revision 2.0uhub0 at usb0 "Intel EHCI root hub" rev
2.00/1.00 addr 1ahci0 at pci0 dev 23 function 0 "Intel Atom C2000 AHCI" rev
0x02: msi, AHCI 1.3ahci0: port 2: 3.0Gb/sscsibus1 at ahci0: 32 targetssd0 at
scsibus1 targ 2 lun 0: <ATA, ADATA SP600, 5.8> SCSI3 0/direct fixed naa.5
707c180000fa546sd0: 30533MB, 512 bytes/sector,
62533296 sectors, thinahci1 at pci0 dev 24 function 0 "Intel Atom C2000 AHCI"
rev 0x02: msi, AHCI 1.3scsibus2 at ahci1: 32 targetspcib0 at pci0 dev 31
function 0 "Intel Atom C2000 PCU" rev 0x02ichiic0 at pci0 dev 31 function 3
"Intel Atom C2000 PCU SMBus" rev 0x02: apic 2
int 18iic0 at ichiic0spdmem0 at iic0 addr 0x50: 8GB DDR3 SDRAM PC3-10600isa0
at pcib0isadma0 at isa0com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte
fifocom0: consolecom1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifopckbc0
at isa0 port 0x60/5 irq 1 irq 12pckbd0 at pckbc0 (kbd slot)wskbd0 at pckbd0:
console keyboardpcppi0 at isa0 port 0x61spkr0 at pcppi0lpt0 at isa0 port
0x378/4 irq 7wbsio0 at isa0 port 0x4e/2: NCT6776F rev 0x33lm1 at wbsio0 port
0xa30/8: NCT6776Fuhub1 at uhub0 port 1 "Intel product 0x07db" rev 2.00/0.02
addr 2vscsi0 at rootscsibus3 at vscsi0: 256 targetssoftraid0 at rootscsibus4 at
softraid0: 256 targetsroot on sd0a (f152e6b03430375f.a) swap on sd0b dump on
sd0b
On Tuesday, December 8, 2015 7:32 PM, Michael McConville
<mm...@mykolab.com> wrote:
Jeff Drago wrote:
> Hello - first post here , hopefully it is the right forum.
>
> I recently setup a bgp box on top of OPENBSD 5.5 Generic.MP, with 6
> INTEL EM nics.The problem is that when I get 700Mbits in one
> interface, the CPU is peaking at 88% (interrupt).
>
> I read about interrupt moderation and I dont know how to play with
> that in my box. is it the case to update the NIC driver? here is the
> reference that the NIC supports int
> moderation:http://download.intel.com/design/network/applnots/ap450.pdf
>
> Not sure how to turn that on or off in OpenBSD. Any help is greatly
> appreciated. Here is the spec for the box (NETMAP
> L-800)http://www.serveru.us/en/images/ServerU/Folder-Brochure_en.pdf
5.5 is no longer supported. Upgrade sequentially (5.5 -> 5.6, 5.6 ->
5.7, 5.7 -> 5.8) and see if that fixes it. I've seen a huge network
performance improvement over that series of upgrades.
Also, if the problem persists, please include a dmesg with your next
email.
Thanks,
Michael