On 2011-03-30 14:27, Claudio Jeker wrote:
> Could you donate a dual port card to the project if you replace them?
> I would like to figure out why some em(4) perform badly while the same
> chip on a different card seems to perform as expected.
>
> Can you provide the vmstat -zi output of the 4 port card? I wonder how
> the interrupts are shared on the 2 port and the 4 port card. IIRC on the
> original vmstat -zi output em0 shared the interrupt with the pci bridge.
>
> --
> :wq Claudio
I have emailed you about the possibilities to donate a card.
We did some more tests today, using only ONE dual port card in the
machine, but the results were the same.
Below is dmesg and vmstat -iz for both the 4-port and the 2-port cards.
4-port card, one card installed in machine:
dmesg:
OpenBSD 4.8 (GENERIC) #182: Mon Aug 16 09:02:40 MDT 2010
dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC
RTC BIOS diagnostic error 3
real mem = 1065857024 (1016MB)
avail mem = 1023684608 (976MB)
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.5 @ 0x3fa32000 (58 entries)
bios0: vendor Intel Corporation version
"S5000.86B.11.00.0096.011320091422" date 01/13/2009
bios0: Intel S5000VSA
acpi0 at bios0: rev 2
acpi0: sleep states S0 S1 S4 S5
acpi0: tables DSDT FACP APIC SPCR HPET MCFG SSDT SSDT SSDT HEST
BERT ERST EINJ
acpi0: wakeup devices SLPB(S5) P32_(S5) PS2M(S1) PS2K(S1)
UAR1(S5) UAR2(S5) UHC1(S1) UHC2(S1) UHC3(S1) UHC4(S1) EHCI(S1) PCIE(S5)
PCIO(S5) PCIP(S5) PCIQ(S5)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2494.04 MHz
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
cpu0: 6MB 64b/line 16-way L2 cache
cpu0: apic clock running at 332MHz
cpu at mainbus0: not configured
cpu at mainbus0: not configured
cpu at mainbus0: not configured
ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins
ioapic1 at mainbus0: apid 9 pa 0xfec80000, version 20, 24 pins
acpihpet0 at acpi0: 14318179 Hz
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 12 (P32_)
acpiprt2 at acpi0: bus 11 (PEX0)
acpiprt3 at acpi0: bus -1 (PEX1)
acpiprt4 at acpi0: bus -1 (PEX2)
acpiprt5 at acpi0: bus -1 (PEX3)
acpiprt6 at acpi0: bus 1 (PCIE)
acpiprt7 at acpi0: bus 9 (PCIE)
acpiprt8 at acpi0: bus 2 (PCIW)
acpiprt9 at acpi0: bus 3 (PCIO)
acpiprt10 at acpi0: bus 4 (PCIP)
acpiprt11 at acpi0: bus 8 (PCIQ)
acpicpu0 at acpi0: C2, C1, PSS
acpibtn0 at acpi0: SLPB
ipmi at mainbus0 not configured
cpu0: Enhanced SpeedStep 2494 MHz: speeds: 2497, 1998 MHz
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel 5000V Host" rev 0xb1
ppb0 at pci0 dev 2 function 0 "Intel 5000 PCIE x8" rev 0xb1
pci1 at ppb0 bus 1
ppb1 at pci1 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01
pci2 at ppb1 bus 2
ppb2 at pci2 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01:
apic 8 int 16 (irq 10)
pci3 at ppb2 bus 3
ppb3 at pci2 dev 1 function 0 "Intel 6321ESB PCIE" rev 0x01:
apic 8 int 17 (irq 11)
pci4 at ppb3 bus 4
ppb4 at pci4 dev 0 function 0 "IDT 89HPES12N3A" rev 0x0e
pci5 at ppb4 bus 5
ppb5 at pci5 dev 2 function 0 "IDT 89HPES12N3A" rev 0x0e
pci6 at ppb5 bus 6
em0 at pci6 dev 0 function 0 "Intel PRO/1000 QP (82576)" rev
0x01: apic 8 int 19 (irq 5), address 00:1b:21:81:57:68
em1 at pci6 dev 0 function 1 "Intel PRO/1000 QP (82576)" rev
0x01: apic 8 int 16 (irq 10), address 00:1b:21:81:57:69
ppb6 at pci5 dev 4 function 0 "IDT 89HPES12N3A" rev 0x0e
pci7 at ppb6 bus 7
em2 at pci7 dev 0 function 0 "Intel PRO/1000 QP (82576)" rev
0x01: apic 8 int 17 (irq 11), address 00:1b:21:81:57:6c
em3 at pci7 dev 0 function 1 "Intel PRO/1000 QP (82576)" rev
0x01: apic 8 int 18 (irq 11), address 00:1b:21:81:57:6d
ppb7 at pci2 dev 2 function 0 "Intel 6321ESB PCIE" rev 0x01
pci8 at ppb7 bus 8
em4 at pci8 dev 0 function 0 "Intel PRO/1000 PT (80003ES2)" rev
0x01: apic 8 int 18 (irq 11), address 00:15:17:60:97:fc
em5 at pci8 dev 0 function 1 "Intel PRO/1000 PT (80003ES2)" rev
0x01: apic 8 int 19 (irq 5), address 00:15:17:60:97:fd
ppb8 at pci1 dev 0 function 3 "Intel 6321ESB PCIE-PCIX" rev 0x01
pci9 at ppb8 bus 9
ppb9 at pci0 dev 3 function 0 "Intel 5000 PCIE" rev 0xb1
pci10 at ppb9 bus 10
pchb1 at pci0 dev 16 function 0 "Intel 5000 Error Reporting"
rev 0xb1
pchb2 at pci0 dev 16 function 1 "Intel 5000 Error Reporting"
rev 0xb1
pchb3 at pci0 dev 16 function 2 "Intel 5000 Error Reporting"
rev 0xb1
pchb4 at pci0 dev 17 function 0 "Intel 5000 Reserved" rev 0xb1
pchb5 at pci0 dev 19 function 0 "Intel 5000 Reserved" rev 0xb1
pchb6 at pci0 dev 21 function 0 "Intel 5000 FBD" rev 0xb1
pchb7 at pci0 dev 22 function 0 "Intel 5000 FBD" rev 0xb1
ppb10 at pci0 dev 28 function 0 "Intel 6321ESB PCIE" rev 0x09:
apic 8 int 16 (irq 10)
pci11 at ppb10 bus 11
uhci0 at pci0 dev 29 function 0 "Intel 6321ESB USB" rev 0x09:
apic 8 int 23 (irq 5)
uhci1 at pci0 dev 29 function 1 "Intel 6321ESB USB" rev 0x09:
apic 8 int 22 (irq 11)
uhci2 at pci0 dev 29 function 2 "Intel 6321ESB USB" rev 0x09:
apic 8 int 23 (irq 5)
uhci3 at pci0 dev 29 function 3 "Intel 6321ESB USB" rev 0x09:
apic 8 int 22 (irq 11)
ehci0 at pci0 dev 29 function 7 "Intel 6321ESB USB" rev 0x09:
apic 8 int 23 (irq 5)
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb11 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev
0xd9
pci12 at ppb11 bus 12
vga1 at pci12 dev 12 function 0 "ATI ES1000" rev 0x02
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
radeondrm0 at vga1: apic 8 int 17 (irq 11)
drm0 at radeondrm0
pcib0 at pci0 dev 31 function 0 "Intel 6321ESB LPC" rev 0x09
pciide0 at pci0 dev 31 function 1 "Intel 6321ESB IDE" rev 0x09:
DMA, channel 0 configured to compatibility, channel 1 configured to
compatibility
wd0 at pciide0 channel 0 drive 0: <WDC WD2500AAJB-00J3A0>
wd0: 16-sector PIO, LBA48, 238475MB, 488397168 sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 5
pciide0: channel 1 disabled (no drives)
ahci0 at pci0 dev 31 function 2 "Intel 6321ESB AHCI" rev 0x09:
apic 8 int 20 (irq 10), AHCI 1.1
scsibus0 at ahci0: 32 targets
cd0 at scsibus0 targ 0 lun 0: <TSSTcorp, CDDVDW SH-S223L, SB01>
ATAPI 5/cdrom removable
ichiic0 at pci0 dev 31 function 3 "Intel 6321ESB SMBus" rev
0x09: apic 8 int 20 (irq 10)
iic0 at ichiic0
usb1 at uhci0: USB revision 1.0
uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb2 at uhci1: USB revision 1.0
uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb3 at uhci2: USB revision 1.0
uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb4 at uhci3: USB revision 1.0
uhub4 at usb4 "Intel UHCI root hub" rev 1.00/1.00 addr 1
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
mtrr: Pentium Pro MTRR support
umass0 at uhub0 port 5 configuration 1 interface 0 "Kingston DT
101 G2" rev 2.00/1.00 addr 2
umass0: using SCSI over Bulk-Only
scsibus1 at umass0: 2 targets, initiator 0
sd0 at scsibus1 targ 1 lun 0: <Kingston, DT 101 G2, 1.00> SCSI2
0/direct removable
sd0: 1910MB, 512 bytes/sec, 3913664 sec total
uhidev0 at uhub1 port 1 configuration 1 interface 0 "CHICONY HP
Basic USB Keyboard" rev 1.10/3.00 addr 2
uhidev0: iclass 3/1
ukbd0 at uhidev0: 8 modifier keys, 6 key codes
wskbd1 at ukbd0 mux 1
wskbd1: connecting to wsdisplay0
softraid0 at root
root on wd0a swap on wd0b dump on wd0b
vmstat -iz:
interrupt total rate
irq0/clock 12734 102
irq144/acpi0 0 0
irq113/ppb2 0 0
irq114/ppb3 0 0
irq112/em0 0 0
irq113/em1 0 0
irq114/em2 0 0
irq115/em3 0 0
irq115/em4 0 0
irq112/em5 0 0
irq113/ppb10 0 0
irq96/uhci0 333 2
irq97/uhci1 0 0
irq96/uhci2 0 0
irq97/uhci3 0 0
irq96/ehci0 202 1
irq98/pciide0 1211 9
irq99/ahci0 1 0
irq99/ichiic0 0 0
irq145/com0 0 0
irq146/com1 0 0
irq147/pckbc0 0 0
Total 14481 116
2-port card, only one istalled in the machine:
dmesg:
OpenBSD 4.8 (GENERIC) #182: Mon Aug 16 09:02:40 MDT 2010
dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC
RTC BIOS diagnostic error 3
real mem = 1065857024 (1016MB)
avail mem = 1023684608 (976MB)
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.5 @ 0x3fa32000 (58 entries)
bios0: vendor Intel Corporation version
"S5000.86B.11.00.0096.011320091422" date 01/13/2009
bios0: Intel S5000VSA
acpi0 at bios0: rev 2
acpi0: sleep states S0 S1 S4 S5
acpi0: tables DSDT FACP APIC SPCR HPET MCFG SSDT SSDT SSDT HEST
BERT ERST EINJ
acpi0: wakeup devices SLPB(S5) P32_(S5) PS2M(S1) PS2K(S1)
UAR1(S5) UAR2(S5) UHC1(S1) UHC2(S1) UHC3(S1) UHC4(S1) EHCI(S1) PCIE(S5)
PCIO(S5) PCIP(S5) PCIQ(S5)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2494.12 MHz
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
cpu0: 6MB 64b/line 16-way L2 cache
cpu0: apic clock running at 332MHz
cpu at mainbus0: not configured
cpu at mainbus0: not configured
cpu at mainbus0: not configured
ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins
ioapic1 at mainbus0: apid 9 pa 0xfec80000, version 20, 24 pins
acpihpet0 at acpi0: 14318179 Hz
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 9 (P32_)
acpiprt2 at acpi0: bus 8 (PEX0)
acpiprt3 at acpi0: bus -1 (PEX1)
acpiprt4 at acpi0: bus -1 (PEX2)
acpiprt5 at acpi0: bus -1 (PEX3)
acpiprt6 at acpi0: bus 1 (PCIE)
acpiprt7 at acpi0: bus 6 (PCIE)
acpiprt8 at acpi0: bus 2 (PCIW)
acpiprt9 at acpi0: bus 3 (PCIO)
acpiprt10 at acpi0: bus 4 (PCIP)
acpiprt11 at acpi0: bus 5 (PCIQ)
acpicpu0 at acpi0: C2, C1, PSS
acpibtn0 at acpi0: SLPB
ipmi at mainbus0 not configured
cpu0: Enhanced SpeedStep 2494 MHz: speeds: 2497, 1998 MHz
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel 5000V Host" rev 0xb1
ppb0 at pci0 dev 2 function 0 "Intel 5000 PCIE x8" rev 0xb1
pci1 at ppb0 bus 1
ppb1 at pci1 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01
pci2 at ppb1 bus 2
ppb2 at pci2 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01:
apic 8 int 16 (irq 10)
pci3 at ppb2 bus 3
ppb3 at pci2 dev 1 function 0 "Intel 6321ESB PCIE" rev 0x01:
apic 8 int 17 (irq 11)
pci4 at ppb3 bus 4
em0 at pci4 dev 0 function 0 "Intel PRO/1000 (82576)" rev 0x01:
apic 8 int 17 (irq 11), address 00:1b:21:9e:35:ba
em1 at pci4 dev 0 function 1 "Intel PRO/1000 (82576)" rev 0x01:
apic 8 int 18 (irq 5), address 00:1b:21:9e:35:bb
ppb4 at pci2 dev 2 function 0 "Intel 6321ESB PCIE" rev 0x01
pci5 at ppb4 bus 5
em2 at pci5 dev 0 function 0 "Intel PRO/1000 PT (80003ES2)" rev
0x01: apic 8 int 18 (irq 5), address 00:15:17:60:97:fc
em3 at pci5 dev 0 function 1 "Intel PRO/1000 PT (80003ES2)" rev
0x01: apic 8 int 19 (irq 11), address 00:15:17:60:97:fd
ppb5 at pci1 dev 0 function 3 "Intel 6321ESB PCIE-PCIX" rev 0x01
pci6 at ppb5 bus 6
ppb6 at pci0 dev 3 function 0 "Intel 5000 PCIE" rev 0xb1
pci7 at ppb6 bus 7
pchb1 at pci0 dev 16 function 0 "Intel 5000 Error Reporting"
rev 0xb1
pchb2 at pci0 dev 16 function 1 "Intel 5000 Error Reporting"
rev 0xb1
pchb3 at pci0 dev 16 function 2 "Intel 5000 Error Reporting"
rev 0xb1
pchb4 at pci0 dev 17 function 0 "Intel 5000 Reserved" rev 0xb1
pchb5 at pci0 dev 19 function 0 "Intel 5000 Reserved" rev 0xb1
pchb6 at pci0 dev 21 function 0 "Intel 5000 FBD" rev 0xb1
pchb7 at pci0 dev 22 function 0 "Intel 5000 FBD" rev 0xb1
ppb7 at pci0 dev 28 function 0 "Intel 6321ESB PCIE" rev 0x09:
apic 8 int 16 (irq 10)
pci8 at ppb7 bus 8
uhci0 at pci0 dev 29 function 0 "Intel 6321ESB USB" rev 0x09:
apic 8 int 23 (irq 11)
uhci1 at pci0 dev 29 function 1 "Intel 6321ESB USB" rev 0x09:
apic 8 int 22 (irq 5)
uhci2 at pci0 dev 29 function 2 "Intel 6321ESB USB" rev 0x09:
apic 8 int 23 (irq 11)
uhci3 at pci0 dev 29 function 3 "Intel 6321ESB USB" rev 0x09:
apic 8 int 22 (irq 5)
ehci0 at pci0 dev 29 function 7 "Intel 6321ESB USB" rev 0x09:
apic 8 int 23 (irq 11)
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb8 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev
0xd9
pci9 at ppb8 bus 9
vga1 at pci9 dev 12 function 0 "ATI ES1000" rev 0x02
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
radeondrm0 at vga1: apic 8 int 17 (irq 11)
drm0 at radeondrm0
pcib0 at pci0 dev 31 function 0 "Intel 6321ESB LPC" rev 0x09
pciide0 at pci0 dev 31 function 1 "Intel 6321ESB IDE" rev 0x09:
DMA, channel 0 configured to compatibility, channel 1 configured to
compatibility
wd0 at pciide0 channel 0 drive 0: <WDC WD2500AAJB-00J3A0>
wd0: 16-sector PIO, LBA48, 238475MB, 488397168 sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 5
pciide0: channel 1 disabled (no drives)
ahci0 at pci0 dev 31 function 2 "Intel 6321ESB AHCI" rev 0x09:
apic 8 int 20 (irq 10), AHCI 1.1
scsibus0 at ahci0: 32 targets
cd0 at scsibus0 targ 0 lun 0: <TSSTcorp, CDDVDW SH-S223L, SB01>
ATAPI 5/cdrom removable
ichiic0 at pci0 dev 31 function 3 "Intel 6321ESB SMBus" rev
0x09: apic 8 int 20 (irq 10)
iic0 at ichiic0
usb1 at uhci0: USB revision 1.0
uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb2 at uhci1: USB revision 1.0
uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb3 at uhci2: USB revision 1.0
uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb4 at uhci3: USB revision 1.0
uhub4 at usb4 "Intel UHCI root hub" rev 1.00/1.00 addr 1
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
mtrr: Pentium Pro MTRR support
uhidev0 at uhub1 port 1 configuration 1 interface 0 "CHICONY HP
Basic USB Keyboard" rev 1.10/3.00 addr 2
uhidev0: iclass 3/1
ukbd0 at uhidev0: 8 modifier keys, 6 key codes
wskbd1 at ukbd0 mux 1
wskbd1: connecting to wsdisplay0
softraid0 at root
root on wd0a swap on wd0b dump on wd0b
umass0 at uhub0 port 5 configuration 1 interface 0 "Kingston DT
101 G2" rev 2.00/1.00 addr 2
umass0: using SCSI over Bulk-Only
scsibus1 at umass0: 2 targets, initiator 0
sd0 at scsibus1 targ 1 lun 0: <Kingston, DT 101 G2, 1.00> SCSI2
0/direct removable
sd0: 1910MB, 512 bytes/sec, 3913664 sec total
vmstat -iz:
interrupt total rate
irq0/clock 78948 100
irq144/acpi0 0 0
irq145/ppb2 0 0
irq112/ppb3 0 0
irq112/em0 330408 419
irq113/em1 115035 146
irq113/em2 164014 208
irq114/em3 0 0
irq145/ppb7 0 0
irq96/uhci0 2453 3
irq97/uhci1 0 0
irq96/uhci2 0 0
irq97/uhci3 0 0
irq96/ehci0 128 0
irq98/pciide0 1262 1
irq99/ahci0 1 0
irq99/ichiic0 0 0
irq146/com0 0 0
irq147/com1 0 0
irq148/pckbc0 0 0
Total 692249 879
