On 2011-06-15 04:26, Jonathan Gray wrote: > Claudio has recently synced ix to a newer version of the Intel code, > if you can try again with -current this should work.
Great, thanks. I tried it out today, but the performance wasn't exactly what I had expected. This is a dual port card, so I bridged ix0 with ix1 and ran iperf between two hosts through the card. The hosts were connected with 1Gbase as I have no other 10Gbase cards. It only got up to about 450 Mbit/s (standard TCP iperf test) and there was an unbalance between ix0 and ix1 when it came to interrupts. ix1 only got up to 4000 intr/s whereas ix1 got up to 13000 intr/s (when monitoring live with systat vmstat). The CPU intr usage was around 50-60%. Could this possibly be related to the ppb problems we've seen with em(4) cards? //Peter vmstat -iz: interrupt total rate irq0/clock 345997 100 irq144/acpi0 0 0 irq96/ppb2 0 0 irq97/ix0 1046011 302 irq96/ix1 327045 94 irq97/ppb3 0 0 irq112/em0 52826 15 irq113/em1 0 0 irq96/ppb7 0 0 irq98/uhci0 444 0 irq99/uhci1 0 0 irq98/uhci2 0 0 irq99/uhci3 0 0 irq98/ehci0 2 0 irq100/pciide0 1462 0 irq101/ahci0 1 0 irq101/ichiic0 0 0 irq145/com0 0 0 irq146/com1 0 0 irq147/pckbc0 0 0 Total 1773788 513 dmesg: OpenBSD 4.9-current (GENERIC) #0: Wed Jun 15 10:51:41 CEST 2011 root@lab:/usr/src/sys/arch/amd64/compile/GENERIC RTC BIOS diagnostic error 3 real mem = 1065857024 (1016MB) avail mem = 1023438848 (976MB) mainbus0 at root bios0 at mainbus0: SMBIOS rev. 2.5 @ 0x3fa32000 (58 entries) bios0: vendor Intel Corporation version "S5000.86B.11.00.0096.011320091422" date 01/13/2009 bios0: Intel S5000VSA acpi0 at bios0: rev 2 acpi0: sleep states S0 S1 S4 S5 acpi0: tables DSDT FACP APIC SPCR HPET MCFG SSDT SSDT SSDT HEST BERT ERST EINJ acpi0: wakeup devices SLPB(S5) P32_(S5) PS2M(S1) PS2K(S1) UAR1(S5) UAR2(S5) UHC1(S1) UHC2(S1) UHC3(S1) UHC4(S1) EHCI(S1) PCIE(S5) PCIO(S5) PCIP(S5) PCIQ(S5) acpitimer0 at acpi0: 3579545 Hz, 24 bits acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat cpu0 at mainbus0: apid 0 (boot processor) cpu0: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2494.10 MHz cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG cpu0: 6MB 64b/line 16-way L2 cache cpu0: apic clock running at 332MHz cpu at mainbus0: not configured cpu at mainbus0: not configured cpu at mainbus0: not configured ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins ioapic1 at mainbus0: apid 9 pa 0xfec80000, version 20, 24 pins acpihpet0 at acpi0: 14318179 Hz acpimcfg0 at acpi0 addr 0xa0000000, bus 0-255 acpiprt0 at acpi0: bus 0 (PCI0) acpiprt1 at acpi0: bus 9 (P32_) acpiprt2 at acpi0: bus 8 (PEX0) acpiprt3 at acpi0: bus -1 (PEX1) acpiprt4 at acpi0: bus -1 (PEX2) acpiprt5 at acpi0: bus -1 (PEX3) acpiprt6 at acpi0: bus 1 (PCIE) acpiprt7 at acpi0: bus 6 (PCIE) acpiprt8 at acpi0: bus 2 (PCIW) acpiprt9 at acpi0: bus 3 (PCIO) acpiprt10 at acpi0: bus 4 (PCIP) acpiprt11 at acpi0: bus 5 (PCIQ) acpicpu0 at acpi0: C2, C1, PSS acpibtn0 at acpi0: SLPB ipmi at mainbus0 not configured cpu0: Enhanced SpeedStep 2494 MHz: speeds: 2497, 1998 MHz pci0 at mainbus0 bus 0 pchb0 at pci0 dev 0 function 0 "Intel 5000V Host" rev 0xb1 ppb0 at pci0 dev 2 function 0 "Intel 5000 PCIE x8" rev 0xb1 pci1 at ppb0 bus 1 ppb1 at pci1 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01 pci2 at ppb1 bus 2 ppb2 at pci2 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01: apic 8 int 16 pci3 at ppb2 bus 3 ix0 at pci3 dev 0 function 0 "Intel 82599 T3" rev 0x01: apic 8 int 17, address 00:1b:21:93:a6:3c ix1 at pci3 dev 0 function 1 "Intel 82599 T3" rev 0x01: apic 8 int 16, address 00:1b:21:93:a6:3d ppb3 at pci2 dev 1 function 0 "Intel 6321ESB PCIE" rev 0x01: apic 8 int 17 pci4 at ppb3 bus 4 ppb4 at pci2 dev 2 function 0 "Intel 6321ESB PCIE" rev 0x01 pci5 at ppb4 bus 5 em0 at pci5 dev 0 function 0 "Intel PRO/1000 PT (80003ES2)" rev 0x01: apic 8 int 18, address 00:15:17:60:97:fc em1 at pci5 dev 0 function 1 "Intel PRO/1000 PT (80003ES2)" rev 0x01: apic 8 int 19, address 00:15:17:60:97:fd ppb5 at pci1 dev 0 function 3 "Intel 6321ESB PCIE-PCIX" rev 0x01 pci6 at ppb5 bus 6 ppb6 at pci0 dev 3 function 0 "Intel 5000 PCIE" rev 0xb1 pci7 at ppb6 bus 7 pchb1 at pci0 dev 16 function 0 "Intel 5000 Error Reporting" rev 0xb1 pchb2 at pci0 dev 16 function 1 "Intel 5000 Error Reporting" rev 0xb1 pchb3 at pci0 dev 16 function 2 "Intel 5000 Error Reporting" rev 0xb1 pchb4 at pci0 dev 17 function 0 "Intel 5000 Reserved" rev 0xb1 pchb5 at pci0 dev 19 function 0 "Intel 5000 Reserved" rev 0xb1 pchb6 at pci0 dev 21 function 0 "Intel 5000 FBD" rev 0xb1 pchb7 at pci0 dev 22 function 0 "Intel 5000 FBD" rev 0xb1 ppb7 at pci0 dev 28 function 0 "Intel 6321ESB PCIE" rev 0x09: apic 8 int 16 pci8 at ppb7 bus 8 uhci0 at pci0 dev 29 function 0 "Intel 6321ESB USB" rev 0x09: apic 8 int 23 uhci1 at pci0 dev 29 function 1 "Intel 6321ESB USB" rev 0x09: apic 8 int 22 uhci2 at pci0 dev 29 function 2 "Intel 6321ESB USB" rev 0x09: apic 8 int 23 uhci3 at pci0 dev 29 function 3 "Intel 6321ESB USB" rev 0x09: apic 8 int 22 ehci0 at pci0 dev 29 function 7 "Intel 6321ESB USB" rev 0x09: apic 8 int 23 usb0 at ehci0: USB revision 2.0 uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1 ppb8 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0xd9 pci9 at ppb8 bus 9 vga1 at pci9 dev 12 function 0 "ATI ES1000" rev 0x02 wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) wsdisplay0: screen 1-5 added (80x25, vt100 emulation) radeondrm0 at vga1: apic 8 int 17 drm0 at radeondrm0 pcib0 at pci0 dev 31 function 0 "Intel 6321ESB LPC" rev 0x09 pciide0 at pci0 dev 31 function 1 "Intel 6321ESB IDE" rev 0x09: DMA, channel 0 configured to compatibility, channel 1 configured to compatibility wd0 at pciide0 channel 0 drive 0: <WDC WD2500JB-00REA0> wd0: 16-sector PIO, LBA48, 238475MB, 488397168 sectors wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 5 pciide0: channel 1 disabled (no drives) ahci0 at pci0 dev 31 function 2 "Intel 6321ESB AHCI" rev 0x09: apic 8 int 20, AHCI 1.1 scsibus0 at ahci0: 32 targets cd0 at scsibus0 targ 0 lun 0: <TSSTcorp, CDDVDW SH-S223L, SB01> ATAPI 5/cdrom removable ichiic0 at pci0 dev 31 function 3 "Intel 6321ESB SMBus" rev 0x09: apic 8 int 20 iic0 at ichiic0 usb1 at uhci0: USB revision 1.0 uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1 usb2 at uhci1: USB revision 1.0 uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1 usb3 at uhci2: USB revision 1.0 uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1 usb4 at uhci3: USB revision 1.0 uhub4 at usb4 "Intel UHCI root hub" rev 1.00/1.00 addr 1 isa0 at pcib0 isadma0 at isa0 com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo pckbc0 at isa0 port 0x60/5 pckbd0 at pckbc0 (kbd slot) pckbc0: using irq 1 for kbd slot wskbd0 at pckbd0: console keyboard, using wsdisplay0 pcppi0 at isa0 port 0x61 spkr0 at pcppi0 mtrr: Pentium Pro MTRR support uhidev0 at uhub1 port 1 configuration 1 interface 0 "CHICONY HP Basic USB Keyboard" rev 1.10/3.00 addr 2 uhidev0: iclass 3/1 ukbd0 at uhidev0: 8 modifier keys, 6 key codes wskbd1 at ukbd0 mux 1 wskbd1: connecting to wsdisplay0 vscsi0 at root scsibus1 at vscsi0: 256 targets softraid0 at root root on wd0a (f7c6f29cb29036dd.a) swap on wd0b dump on wd0b