So are you using DPDK as Don asked previously?
Cheers,
John
From: Kaushal Bhandankar [mailto:[email protected]]
Sent: Thursday, July 04, 2013 9:39 AM
To: Skidmore, Donald C; Ronciak, John
Cc: [email protected]
Subject: Re: [E1000-devel] Intel 82599 Driver dropping packets Queue Receive
Descriptor Head
Hi all,
I have dumped the Rx ring descriptor status when this happens. This is what I
found
"qprdc" ="Queue Packet Receive Drop Count">1602602</token>
"qrdh" ="Queue Receive Descriptor Head">1256</token>
qrdt" ="Queue Receive Descriptor Tail">1256</token>
qrdntc" ="Queue Receive Descriptor Next to Check">1257</token>
qrdlc" ="Queue Receive Descriptor Last Cleaned">1256</token>
I checked the status of the Rx Ring descriptos from 1257 onwards.
Descriptor 1257 status 0
Descriptor 1258 status 0
Descriptor 1259 status 0
...
...
...
Descriptor 1247 status 0
Descriptor 1248 status 0
Descriptor 1249 status -1073741725
Descriptor 1250 status -1073741725
Descriptor 1251 status -1073741725
Descriptor 1252 status -1073741725
Descriptor 1253 status -1073741725
Descriptor 1254 status -1073741725
Descriptor 1255 status -1073741725
Descriptor 1256 status 0
This means that the Application sees that the Rx_ring is empty, but actualy
Rx_ring is full and is in a bad state. Any idea what may be happening ?
Regards,
Kaushal
On Tue, Jun 18, 2013 at 11:48 PM, Skidmore, Donald C
<[email protected]<mailto:[email protected]>> wrote:
Hey Kaushal,
So can I assume you are using DPDK for your driver? I ask because of the
tap_create call you mentioned. If so I've only had limited exposure to that
driver as a different group does its development. If that is the cause I can
see if I can find you someone in that group to talk with.
Thanks,
-Don Skidmore <[email protected]<mailto:[email protected]>>
From: Kaushal Bhandankar
[mailto:[email protected]<mailto:[email protected]>]
Sent: Monday, June 17, 2013 7:32 PM
To: Skidmore, Donald C
Cc: [email protected]<mailto:[email protected]>
Subject: Re: [E1000-devel] Intel 82599 Driver dropping packets Queue Receive
Descriptor Head
Thanks for the reply. I ll elaborate the issue we are seeing.
When the affected queue started dropping packets, it had received 50% of
traffic comapred to any other queue which was working fine. After this the
traffic was diverted to another box. With no traffic in the Box, the affected
Queue drops 100 % packets it sees. We do not use interrupt mechanism in our
case. The Niantic hardware nic calculates the hash and puts the packet in the
appropriate queue. The user Application directly read from this queue. There is
no driver running in Kernel space. This is done to improve performance of the
system. Also, We area creating a tap interface using ixgbe_tap_create call.
=============
-bash-3.2# dmesg
q 15
ide-gd driver 1.18
Driver 'sd' needs updating - please use bus_type methods
Driver 'sr' needs updating - please use bus_type methods
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
ehci_hcd 0000:00:1a.7: PCI INT C -> GSI 18 (level, low) -> IRQ 18
ehci_hcd 0000:00:1a.7: setting latency timer to 64
ehci_hcd 0000:00:1a.7: EHCI Host Controller
ehci_hcd 0000:00:1a.7: new USB bus registered, assigned bus number 1
ehci_hcd 0000:00:1a.7: debug port 1
ehci_hcd 0000:00:1a.7: cache line size of 32 is not supported
ehci_hcd 0000:00:1a.7: irq 18, io mem 0xdbbde000
ehci_hcd 0000:00:1a.7: USB 2.0 started, EHCI 1.00
usb usb1: configuration #1 chosen from 1 choice
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 6 ports detected
ehci_hcd 0000:00:1d.7: PCI INT A -> GSI 16 (level, low) -> IRQ 16
ehci_hcd 0000:00:1d.7: setting latency timer to 64
ehci_hcd 0000:00:1d.7: EHCI Host Controller
ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 2
ehci_hcd 0000:00:1d.7: debug port 1
ehci_hcd 0000:00:1d.7: cache line size of 32 is not supported
ehci_hcd 0000:00:1d.7: irq 16, io mem 0xdbbdf000
ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00
usb usb2: configuration #1 chosen from 1 choice
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 6 ports detected
ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
uhci_hcd: USB Universal Host Controller Interface driver
uhci_hcd 0000:00:1a.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
uhci_hcd 0000:00:1a.0: setting latency timer to 64
uhci_hcd 0000:00:1a.0: UHCI Host Controller
uhci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 3
uhci_hcd 0000:00:1a.0: irq 16, io base 0x0000ac20
usb usb3: configuration #1 chosen from 1 choice
hub 3-0:1.0: USB hub found
hub 3-0:1.0: 2 ports detected
uhci_hcd 0000:00:1a.1: PCI INT B -> GSI 17 (level, low) -> IRQ 17
uhci_hcd 0000:00:1a.1: setting latency timer to 64
uhci_hcd 0000:00:1a.1: UHCI Host Controller
uhci_hcd 0000:00:1a.1: new USB bus registered, assigned bus number 4
uhci_hcd 0000:00:1a.1: irq 17, io base 0x0000ac40
usb usb4: configuration #1 chosen from 1 choice
hub 4-0:1.0: USB hub found
hub 4-0:1.0: 2 ports detected
uhci_hcd 0000:00:1a.2: PCI INT C -> GSI 18 (level, low) -> IRQ 18
uhci_hcd 0000:00:1a.2: setting latency timer to 64
uhci_hcd 0000:00:1a.2: UHCI Host Controller
uhci_hcd 0000:00:1a.2: new USB bus registered, assigned bus number 5
uhci_hcd 0000:00:1a.2: irq 18, io base 0x0000ac60
usb usb5: configuration #1 chosen from 1 choice
hub 5-0:1.0: USB hub found
hub 5-0:1.0: 2 ports detected
uhci_hcd 0000:00:1d.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
uhci_hcd 0000:00:1d.0: setting latency timer to 64
uhci_hcd 0000:00:1d.0: UHCI Host Controller
uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 6
uhci_hcd 0000:00:1d.0: irq 16, io base 0x0000ac80
usb usb6: configuration #1 chosen from 1 choice
hub 6-0:1.0: USB hub found
hub 6-0:1.0: 2 ports detected
uhci_hcd 0000:00:1d.1: PCI INT B -> GSI 17 (level, low) -> IRQ 17
uhci_hcd 0000:00:1d.1: setting latency timer to 64
uhci_hcd 0000:00:1d.1: UHCI Host Controller
uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 7
uhci_hcd 0000:00:1d.1: irq 17, io base 0x0000aca0
usb usb7: configuration #1 chosen from 1 choice
hub 7-0:1.0: USB hub found
hub 7-0:1.0: 2 ports detected
uhci_hcd 0000:00:1d.2: PCI INT C -> GSI 18 (level, low) -> IRQ 18
uhci_hcd 0000:00:1d.2: setting latency timer to 64
uhci_hcd 0000:00:1d.2: UHCI Host Controller
uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 8
uhci_hcd 0000:00:1d.2: irq 18, io base 0x0000acc0
usb usb8: configuration #1 chosen from 1 choice
hub 8-0:1.0: USB hub found
hub 8-0:1.0: 2 ports detected
Initializing USB Mass Storage driver...
usbcore: registered new interface driver usb-storage
USB Mass Storage support registered.
PNP: No PS/2 controller found. Probing ports directly.
i8042.c: No controller found.
mice: PS/2 mouse device common for all mice
rtc_cmos 00:09: RTC can wake from S4
rtc_cmos 00:09: rtc core: registered rtc_cmos as rtc0
rtc0: alarms up to one day, 114 bytes nvram
i2c /dev entries driver
i801_smbus 0000:00:1f.3: PCI INT C -> GSI 18 (level, low) -> IRQ 18
device-mapper: ioctl: 4.14.0-ioctl (2008-04-23) initialised:
[email protected]<mailto:[email protected]>
cpuidle: using governor ladder
ioatdma 0000:00:16.0: can't derive routing for PCI INT A
ioatdma 0000:00:16.0: PCI INT A: no GSI
ioatdma 0000:00:16.0: setting latency timer to 64
ioatdma 0000:00:16.0: Intel(R) I/OAT DMA Engine found, 1 channels, device
version 0x30, driver version 3.64
ioatdma 0000:00:16.0: irq 68 for MSI/MSI-X
ioatdma 0000:00:16.0: DCA is disabled in BIOS
ioatdma 0000:00:16.1: can't derive routing for PCI INT B
ioatdma 0000:00:16.1: PCI INT B: no GSI
ioatdma 0000:00:16.1: setting latency timer to 64
ioatdma 0000:00:16.1: Intel(R) I/OAT DMA Engine found, 1 channels, device
version 0x30, driver version 3.64
ioatdma 0000:00:16.1: irq 69 for MSI/MSI-X
ioatdma 0000:00:16.1: DCA is disabled in BIOS
ioatdma 0000:00:16.2: can't derive routing for PCI INT C
ioatdma 0000:00:16.2: PCI INT C: no GSI
ioatdma 0000:00:16.2: setting latency timer to 64
ioatdma 0000:00:16.2: Intel(R) I/OAT DMA Engine found, 1 channels, device
version 0x30, driver version 3.64
ioatdma 0000:00:16.2: irq 70 for MSI/MSI-X
Clocksource tsc unstable (delta = 4687261807 ns)
usb 1-4: new high speed USB device using ehci_hcd and address 2
ioatdma 0000:00:16.2: DCA is disabled in BIOS
ioatdma 0000:00:16.3: can't derive routing for PCI INT D
ioatdma 0000:00:16.3: PCI INT D: no GSI
ioatdma 0000:00:16.3: setting latency timer to 64
ioatdma 0000:00:16.3: Intel(R) I/OAT DMA Engine found, 1 channels, device
version 0x30, driver version 3.64
ioatdma 0000:00:16.3: irq 71 for MSI/MSI-X
ioatdma 0000:00:16.3: DCA is disabled in BIOS
ioatdma 0000:00:16.4: can't derive routing for PCI INT A
ioatdma 0000:00:16.4: PCI INT A: no GSI
ioatdma 0000:00:16.4: setting latency timer to 64
ioatdma 0000:00:16.4: Intel(R) I/OAT DMA Engine found, 1 channels, device
version 0x30, driver version 3.64
ioatdma 0000:00:16.4: irq 72 for MSI/MSI-X
usb 1-4: configuration #1 chosen from 1 choice
scsi0 : SCSI emulation for USB Mass Storage devices
ioatdma 0000:00:16.4: DCA is disabled in BIOS
ioatdma 0000:00:16.5: can't derive routing for PCI INT B
ioatdma 0000:00:16.5: PCI INT B: no GSI
ioatdma 0000:00:16.5: setting latency timer to 64
ioatdma 0000:00:16.5: Intel(R) I/OAT DMA Engine found, 1 channels, device
version 0x30, driver version 3.64
ioatdma 0000:00:16.5: irq 73 for MSI/MSI-X
ioatdma 0000:00:16.5: DCA is disabled in BIOS
ioatdma 0000:00:16.6: can't derive routing for PCI INT C
ioatdma 0000:00:16.6: PCI INT C: no GSI
ioatdma 0000:00:16.6: setting latency timer to 64
ioatdma 0000:00:16.6: Intel(R) I/OAT DMA Engine found, 1 channels, device
version 0x30, driver version 3.64
ioatdma 0000:00:16.6: irq 74 for MSI/MSI-X
ioatdma 0000:00:16.6: DCA is disabled in BIOS
ioatdma 0000:00:16.7: can't derive routing for PCI INT D
ioatdma 0000:00:16.7: PCI INT D: no GSI
ioatdma 0000:00:16.7: setting latency timer to 64
ioatdma 0000:00:16.7: Intel(R) I/OAT DMA Engine found, 1 channels, device
version 0x30, driver version 3.64
ioatdma 0000:00:16.7: irq 75 for MSI/MSI-X
ioatdma 0000:00:16.7: DCA is disabled in BIOS
usbcore: registered new interface driver usbhid
usbhid: v2.6:USB HID core driver
TCP cubic registered
IPv6: Loaded, but is disabled by default. IPv6 may be enabled on individual
interfaces.
NET: Registered protocol family 10
NET: Registered protocol family 17
NET: Registered protocol family 5
usb-storage: device found at 2
usb-storage: waiting for device to settle before scanning
rtc_cmos 00:09: setting system clock to 2013-04-24 08:30:08 UTC (1366792208)
Freeing unused kernel memory: 1032k freed
Write protecting the kernel read-only data: 4272k
scsi 0:0:0:0: Direct-Access Unigen CEU2000 1100 PQ: 0 ANSI: 0 CCS
sd 0:0:0:0: [sda] 4014080 512-byte hardware sectors: (2.05 GB/1.91 GiB)
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Mode Sense: 43 00 00 00
sd 0:0:0:0: [sda] Assuming drive cache: write through
sd 0:0:0:0: [sda] 4014080 512-byte hardware sectors: (2.05 GB/1.91 GiB)
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Mode Sense: 43 00 00 00
sd 0:0:0:0: [sda] Assuming drive cache: write through
sda: sda1 sda2 sda3 sda4
sd 0:0:0:0: [sda] Attached SCSI removable disk
sd 0:0:0:0: Attached scsi generic sg0 type 0
usb-storage: device scan complete
kjournald starting. Commit interval 5 seconds
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting. Commit interval 5 seconds
EXT3 FS on sda2, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting. Commit interval 5 seconds
EXT3-fs: mounted filesystem with ordered data mode.
linux_kernel_bde: module license 'Proprietary' taints kernel.
linux-kernel-bde 0000:12:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
linux-kernel-bde (25599): ** Alloc contiguous DMA-able memroy 8388608 bytes
=======> totalram(6148886) PAGE_SHIFT(12) blk_size(524288) order(7)
PAGE_SIZE(4096)
==========> 24
linux-kernel-bde (25599): alloc_mpool : dma_pbase (0xd7400000) dma_vbase
(ffff8803d7400000)
EXT3 FS on sda1, internal journal
cpp INFO at cppInitBusDevice:862: Detected Tarari device 0, deviceId 0x0a05 on
bus=11, slot=0
pci 0000:0b:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:0b:00.0: irq 76 for MSI/MSI-X
IHM: Initializing Interface Helper Module
IHM: registering chr device
Module registered 248, from (pid 26094)
Probe called with class 0x0
Bus 8 Dev 0 Func 0
ihm 0000:08:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
ihm 0000:08:00.0: setting latency timer to 64
Probe called with class 0x0
Bus 8 Dev 0 Func 1
ihm 0000:08:00.1: PCI INT B -> GSI 17 (level, low) -> IRQ 17
ihm 0000:08:00.1: setting latency timer to 64
Probe called with class 0x0
Bus 10 Dev 0 Func 0
ihm 0000:0a:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
ihm 0000:0a:00.0: setting latency timer to 64
Probe called with class 0x0
Bus 10 Dev 0 Func 1
ihm 0000:0a:00.1: PCI INT B -> GSI 17 (level, low) -> IRQ 17
ihm 0000:0a:00.1: setting latency timer to 64
ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 2.0.38.3-NAPI
Copyright (c) 1999-2009 Intel Corporation.
IHM: Remove called
ihm 0000:08:00.1: PCI INT B disabled
ixgbe 0000:08:00.1: PCI INT B -> GSI 17 (level, low) -> IRQ 17
ixgbe 0000:08:00.1: enabling bus mastering
ixgbe 0000:08:00.1: setting latency timer to 64
ixgbe: 0000:08:00.1: ixgbe_check_options: Flow Director hash filtering enabled
ixgbe: 0000:08:00.1: ixgbe_check_options: Flow Director allocated 64kB of
packet buffer
ixgbe: 0000:08:00.1: ixgbe_check_options: ATR Tx Packet sample rate set to
default of 20
ixgbe 0000:08:00.1: irq 77 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 78 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 79 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 80 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 81 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 82 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 83 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 84 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 85 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 86 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 87 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 88 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 89 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 90 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 91 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 92 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 93 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 94 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 95 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 96 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 97 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 98 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 99 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 100 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 101 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 102 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 103 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 104 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 105 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 106 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 107 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 108 for MSI/MSI-X
ixgbe 0000:08:00.1: irq 109 for MSI/MSI-X
ixgbe: 0000:08:00.1: ixgbe_init_interrupt_scheme: Multiqueue Enabled: Rx Queue
count = 16, Tx Queue count = 16
ixgbe: 0000:08:00.1: ixgbe_probe: Double Vlan Mode not Enabled
ixgbe: eth0: ixgbe_probe: No DCA provider found. Please start ioatdma for DCA
functionality.
ixgbe: eth0: ixgbe_probe: (PCI Express:5.0Gb/s:Width x8) 00:00:00:01:00:02
ixgbe: eth0: ixgbe_probe: MAC: 2, PHY: 1, PBA No: ffffff-0ff
ixgbe: eth0: ixgbe_probe: LRO is disabled
ixgbe: eth0: ixgbe_probe: HW RSC is enabled
ixgbe: eth0: ixgbe_probe: Intel(R) 10 Gigabit Network Connection
IHM: Remove called
ihm 0000:0a:00.0: PCI INT A disabled
e1000e: Intel(R) PRO/1000 Network Driver - 0.3.3.3-k6
e1000e: Copyright (c) 1999-2008 Intel Corporation.
e1000e 0000:10:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
e1000e 0000:10:00.0: setting latency timer to 64
e1000e 0000:10:00.0: irq 110 for MSI/MSI-X
e1000e 0000:10:00.0: irq 111 for MSI/MSI-X
e1000e 0000:10:00.0: irq 112 for MSI/MSI-X
0000:10:00.0: eth1: (PCI Express:2.5GB/s:Width x1) 70:ca:9b:f0:4f:85
0000:10:00.0: eth1: Intel(R) PRO/1000 Network Connection
0000:10:00.0: eth1: MAC: 3, PHY: 8, PBA No: 1020ff-0ff
e1000e 0000:11:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
e1000e 0000:11:00.0: setting latency timer to 64
e1000e 0000:11:00.0: irq 113 for MSI/MSI-X
e1000e 0000:11:00.0: irq 114 for MSI/MSI-X
e1000e 0000:11:00.0: irq 115 for MSI/MSI-X
0000:11:00.0: eth2: (PCI Express:2.5GB/s:Width x1) 70:ca:9b:f0:4f:84
0000:11:00.0: eth2: Intel(R) PRO/1000 Network Connection
0000:11:00.0: eth2: MAC: 3, PHY: 8, PBA No: 1020ff-0ff
Intel(R) Gigabit Ethernet Network Driver - version 1.2.45-k2
Copyright (c) 2008 Intel Corporation.
ip_tables: (C) 2000-2006 Netfilter Core Team
nf_conntrack version 0.5.0 (16384 buckets, 65536 max)
CONFIG_NF_CT_ACCT is deprecated and will be removed soon. Please use
nf_conntrack.acct=1 kernel paramater, acct=1 nf_conntrack module option or
sysctl net.netfilter.nf_conntrack_acct=1 to enable it.
ixgbe: sy0_0: ixgbe_watchdog_task: NIC Link is Up 10 Gbps, Flow Control: RX/TX
ADDRCONF(NETDEV_UP): sy0_0: link is not ready
ADDRCONF(NETDEV_CHANGE): sy0_0: link becomes ready
TIPC: Activated (version 1.6.4 compiled Apr 24 2012 03:29:39)
NET: Registered protocol family 30
TIPC: Started in single node mode
TIPC: Started in network mode
TIPC: Own node address <1.1.2>, network identity 1234
TIPC: Enabled bearer <eth:sy0_0>, discovery domain <1.1.0>, priority 10
TIPC: Established link <1.1.2:sy0_0-1.1.1:tap0> on network plane A
ADDRCONF(NETDEV_UP): ma0_0: link is not ready
e1000e: ma0_0 NIC Link is Up 100 Mbps Full Duplex, Flow Control: None
0000:11:00.0: ma0_0: 10/100 speed: disabling TSO
ADDRCONF(NETDEV_CHANGE): ma0_0: link becomes ready
device po0_0 entered promiscuous mode
device po0_0 left promiscuous mode
device po0_0 entered promiscuous mode
device po0_0 left promiscuous mode
device po0_0 entered promiscuous mode
device po0_0 left promiscuous mode
device po0_0 entered promiscuous mode
device po0_0 left promiscuous mode
device po0_0 entered promiscuous mode
device po0_0 left promiscuous mode
device po0_0 entered promiscuous mode
device po0_0 left promiscuous mode
device po0_0 entered promiscuous mode
device po0_0 left promiscuous mode
device po0_0 entered promiscuous mode
device po0_0 left promiscuous mode
device po0_0 entered promiscuous mode
device po0_0 left promiscuous mode
-bash-3.2# su - cisco
CLMBOH0001-IPS903# show int port
portChannel portChannel0/0
CLMBOH0001-IPS903# show int portChannel
MAC statistics from interface PortChannel0/0
Interface function = Sensing interface
Description =
Media Type = backplane
Default Vlan = 0
InlineMode = Unpaired
Pair Status = N/A
Hardware Bypass Capable = No
Hardware Bypass Paired = N/A
Link Status = Up
Admin Enabled Status = Enabled
Link Speed = Auto_10000
Link Duplex = Auto_Full
Missed Packet Percentage = 0
Total Packets Received = 3479352341
Total Bytes Received = 3963816352204
Total Multicast Packets Received = 0
Total Broadcast Packets Received = 0
Total Jumbo Packets Received = 877491302
Total Undersize Packets Received = 0
Total Receive Errors = 2498336
Total Receive FIFO Overruns = 0
Total requests for buffer when none available = 0
Total Packets Transmitted = 3479352325
Total Bytes Transmitted = 3963816303436
Total Multicast Packets Transmitted = 0
Total Broadcast Packets Transmitted = 0
Total Jumbo Packets Transmitted = 877491301
Total Undersize Packets Transmitted = 0
Total Transmit Errors = 0
Total Transmit FIFO Overruns = 0
CLMBOH0001-IPS903# exit
==================
exec: /sbin/lspci -s 08:0.0 -vvv
08:00.0 Class 0200: Device 8086:10fc (rev 01)
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping-
SERR- FastB2B- DisINTx-
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
<MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 16
Region 0: Memory at decc0000 (64-bit, non-prefetchable) [size=128K]
Region 2: I/O ports at fcc0 [size=32]
Region 4: Memory at decb8000 (64-bit, non-prefetchable) [size=16K]
Capabilities: [40] Power Management version 3
Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold-)
Status: D0 PME-Enable- DSel=0 DScale=1 PME-
Capabilities: [50] Message Signalled Interrupts: Mask+ 64bit+ Count=1/1 Enable-
Address: 0000000000000000 Data: 0000
Masking: 00000000 Pending: 00000000
Capabilities: [70] MSI-X: Enable- Mask- TabSize=64
Vector table: BAR=4 offset=00000000
PBA: BAR=4 offset=00002000
Capabilities: [a0] Express (v2) Endpoint, MSI 00
DevCap:MaxPayload 512 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+
DevCtl:Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
MaxPayload 256 bytes, MaxReadReq 512 bytes
DevSta:CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
LnkCap:Port #0, Speed 5GT/s, Width x8, ASPM L0s, Latency L0 unlimited, L1 <32us
ClockPM- Suprise- LLActRep- BwNot-
LnkCtl:ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta:Speed 5GT/s, Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable
De-emphasis: -6dB
Transmit Margin: Normal Operating Range, EnterModifiedCompliance-
ComplianceSOS-
Compliance De-emphasis: -6dB
LnkSta2: Current De-emphasis Level: -6dB
Capabilities: [e0] Vital Product Data <?>
Capabilities: [100] Advanced Error Reporting
UESta:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC-
UnsupReq- ACSVoil-
UEMsk:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC-
UnsupReq- ACSVoil-
UESvrt:DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC-
UnsupReq- ACSVoil-
CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
AERCap:First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
Capabilities: [140] Device Serial Number 01-00-01-ff-ff-00-00-00
Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
ARICap:MFVC- ACS-, Next Function: 1
ARICtl:MFVC- ACS-, Function Group: 0
Capabilities: [160] Single Root I/O Virtualization (SR-IOV)
IOVCap:Migration-, Interrupt Message Number: 000
IOVCtl:Enable- Migration- Interrupt- MSE- ARIHierarchy-
IOVSta:Migration-
Initial VFs: 64, Total VFs: 64, Number of VFs: 0, Function Dependency Link: 00
VF offset: 384, stride: 2, Device ID: 10ed
Supported Page Size: 00000553, System Page Size: 00000001
VF Migration: offset: 00000000, BIR: 1
Kernel driver in use: ihm
Kernel modules: ixgbe
exec: /sbin/lspci -s 08:0.0 -vvv
08:00.0 Class 0200: Device 8086:10fc (rev 01)
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping-
SERR- FastB2B- DisINTx-
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
<MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 16
Region 0: Memory at decc0000 (64-bit, non-prefetchable) [size=128K]
Region 2: I/O ports at fcc0 [size=32]
Region 4: Memory at decb8000 (64-bit, non-prefetchable) [size=16K]
Capabilities: [40] Power Management version 3
Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold-)
Status: D0 PME-Enable- DSel=0 DScale=1 PME-
Capabilities: [50] Message Signalled Interrupts: Mask+ 64bit+ Count=1/1 Enable-
Address: 0000000000000000 Data: 0000
Masking: 00000000 Pending: 00000000
Capabilities: [70] MSI-X: Enable- Mask- TabSize=64
Vector table: BAR=4 offset=00000000
PBA: BAR=4 offset=00002000
Capabilities: [a0] Express (v2) Endpoint, MSI 00
DevCap:MaxPayload 512 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+
DevCtl:Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
MaxPayload 256 bytes, MaxReadReq 512 bytes
DevSta:CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
LnkCap:Port #0, Speed 5GT/s, Width x8, ASPM L0s, Latency L0 unlimited, L1 <32us
ClockPM- Suprise- LLActRep- BwNot-
LnkCtl:ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta:Speed 5GT/s, Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable
De-emphasis: -6dB
Transmit Margin: Normal Operating Range, EnterModifiedCompliance-
ComplianceSOS-
Compliance De-emphasis: -6dB
LnkSta2: Current De-emphasis Level: -6dB
Capabilities: [e0] Vital Product Data <?>
Capabilities: [100] Advanced Error Reporting
UESta:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC-
UnsupReq- ACSVoil-
UEMsk:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC-
UnsupReq- ACSVoil-
UESvrt:DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC-
UnsupReq- ACSVoil-
CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
AERCap:First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
Capabilities: [140] Device Serial Number 01-00-01-ff-ff-00-00-00
Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
ARICap:MFVC- ACS-, Next Function: 1
ARICtl:MFVC- ACS-, Function Group: 0
Capabilities: [160] Single Root I/O Virtualization (SR-IOV)
IOVCap:Migration-, Interrupt Message Number: 000
IOVCtl:Enable- Migration- Interrupt- MSE- ARIHierarchy-
IOVSta:Migration-
Initial VFs: 64, Total VFs: 64, Number of VFs: 0, Function Dependency Link: 00
VF offset: 384, stride: 2, Device ID: 10ed
Supported Page Size: 00000553, System Page Size: 00000001
VF Migration: offset: 00000000, BIR: 1
Kernel driver in use: ihm
Kernel modules: ixgbe
exec: /sbin/lspci -s 0a:0.0 -vvv
0a:00.0 Class 0200: Device 8086:10fc (rev 01)
Control: I/O+ Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping-
SERR- FastB2B- DisINTx-
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
<MAbort- >SERR- <PERR- INTx-
Interrupt: pin A routed to IRQ 16
Region 0: Memory at de5c0000 (64-bit, non-prefetchable) [size=128K]
Region 2: I/O ports at ecc0 [size=32]
Region 4: Memory at de5b8000 (64-bit, non-prefetchable) [size=16K]
Capabilities: [40] Power Management version 3
Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold-)
Status: D0 PME-Enable- DSel=0 DScale=1 PME-
Capabilities: [50] Message Signalled Interrupts: Mask+ 64bit+ Count=1/1 Enable-
Address: 0000000000000000 Data: 0000
Masking: 00000000 Pending: 00000000
Capabilities: [70] MSI-X: Enable- Mask- TabSize=64
Vector table: BAR=4 offset=00000000
PBA: BAR=4 offset=00002000
Capabilities: [a0] Express (v2) Endpoint, MSI 00
DevCap:MaxPayload 512 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+
DevCtl:Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
MaxPayload 256 bytes, MaxReadReq 512 bytes
DevSta:CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
LnkCap:Port #0, Speed 5GT/s, Width x8, ASPM L0s, Latency L0 unlimited, L1 <32us
ClockPM- Suprise- LLActRep- BwNot-
LnkCtl:ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta:Speed 5GT/s, Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable
De-emphasis: -6dB
Transmit Margin: Normal Operating Range, EnterModifiedCompliance-
ComplianceSOS-
Compliance De-emphasis: -6dB
LnkSta2: Current De-emphasis Level: -6dB
Capabilities: [e0] Vital Product Data <?>
Capabilities: [100] Advanced Error Reporting
UESta:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC-
UnsupReq- ACSVoil-
UEMsk:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC-
UnsupReq- ACSVoil-
UESvrt:DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC-
UnsupReq- ACSVoil-
CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
AERCap:First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
Capabilities: [140] Device Serial Number 03-00-01-ff-ff-00-00-00
Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
ARICap:MFVC- ACS-, Next Function: 1
ARICtl:MFVC- ACS-, Function Group: 0
Capabilities: [160] Single Root I/O Virtualization (SR-IOV)
IOVCap:Migration-, Interrupt Message Number: 000
IOVCtl:Enable- Migration- Interrupt- MSE- ARIHierarchy-
IOVSta:Migration-
Initial VFs: 64, Total VFs: 64, Number of VFs: 0, Function Dependency Link: 00
VF offset: 384, stride: 2, Device ID: 10ed
Supported Page Size: 00000553, System Page Size: 00000001
VF Migration: offset: 00000000, BIR: 1
Kernel modules: ixgbe
exec: /sbin/lspci -s 09:0.0 -vvv
exec: /sbin/lspci -s 0b:0.0 -vvv
0b:00.0 Class 0b40: Device 1000:0a05 (rev 01)
Subsystem: Device 1000:0a0a
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping-
SERR- FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
<MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 76
Region 0: Memory at de200000 (64-bit, non-prefetchable) [size=1M]
Capabilities: [40] Power Management version 3
Flags: PMEClk- DSI- D1+ D2- AuxCurrent=375mA PME(D0+,D1+,D2-,D3hot+,D3cold-)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [50] Message Signalled Interrupts: Mask- 64bit+ Count=1/1 Enable+
Address: 00000000fee00000 Data: 409a
Capabilities: [70] Express (v2) Endpoint, MSI 00
DevCap:MaxPayload 256 bytes, PhantFunc 0, Latency L0s <128ns, L1 <2us
ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
DevCtl:Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop-
MaxPayload 128 bytes, MaxReadReq 256 bytes
DevSta:CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend+
LnkCap:Port #0, Speed 2.5GT/s, Width x8, ASPM L0s L1, Latency L0 <512ns, L1
<64us
ClockPM- Suprise- LLActRep- BwNot-
LnkCtl:ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta:Speed 2.5GT/s, Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt-
ABWMgmt-
DevCap2: Completion Timeout: Not Supported, TimeoutDis+
DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable
De-emphasis: -6dB
Transmit Margin: Normal Operating Range, EnterModifiedCompliance-
ComplianceSOS-
Compliance De-emphasis: -6dB
LnkSta2: Current De-emphasis Level: -6dB
Capabilities: [b0] MSI-X: Enable- Mask- TabSize=33
Vector table: BAR=0 offset=00000000
PBA: BAR=0 offset=00000000
Capabilities: [100] Advanced Error Reporting
UESta:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC-
UnsupReq- ACSVoil-
UEMsk:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC-
UnsupReq- ACSVoil-
UESvrt:DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC-
UnsupReq- ACSVoil-
CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
AERCap:First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
Capabilities: [140] Virtual Channel <?>
exec: /sbin/lspci -s 0c:0.0 -vvv
0c:00.0 Class 0100: Device 1000:0056 (rev 10)
Subsystem: Device 1000:3180
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping-
SERR- FastB2B- DisINTx-
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
<MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 5
Region 0: I/O ports at dc00 [size=256]
Region 1: Memory at dddec000 (64-bit, non-prefetchable) [size=16K]
Region 3: Memory at dddf0000 (64-bit, non-prefetchable) [size=64K]
Expansion ROM at dde00000 [disabled] [size=2M]
Capabilities: [50] Power Management version 2
Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [68] Express (v1) Endpoint, MSI 00
DevCap:MaxPayload 4096 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
ExtTag+ AttnBtn- AttnInd- PwrInd- RBE- FLReset-
DevCtl:Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
MaxPayload 128 bytes, MaxReadReq 512 bytes
DevSta:CorrErr- UncorrErr+ FatalErr- UnsuppReq+ AuxPwr- TransPend-
LnkCap:Port #0, Speed 2.5GT/s, Width x8, ASPM L0s L1, Latency L0 <64ns, L1 <1us
ClockPM- Suprise- LLActRep- BwNot-
LnkCtl:ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta:Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk- DLActive- BWMgmt-
ABWMgmt-
Capabilities: [98] Message Signalled Interrupts: Mask- 64bit+ Count=1/1 Enable-
Address: 0000000000000000 Data: 0000
Capabilities: [b0] MSI-X: Enable- Mask- TabSize=1
Vector table: BAR=1 offset=00002000
PBA: BAR=1 offset=00003000
Capabilities: [100] Advanced Error Reporting
UESta:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC-
UnsupReq+ ACSVoil-
UEMsk:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC-
UnsupReq- ACSVoil-
UESvrt:DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC-
UnsupReq- ACSVoil-
CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
AERCap:First Error Pointer: 14, GenCap+ CGenEn- ChkCap+ ChkEn-
exec: /sbin/lspci -s 10:0.0 -vvv
10:00.0 Class 0200: Device 8086:10d3
Subsystem: Device 8086:0000
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping-
SERR- FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
<MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 16
Region 0: Memory at dcee0000 (32-bit, non-prefetchable) [size=128K]
Region 2: I/O ports at cce0 [size=32]
Region 3: Memory at dcedc000 (32-bit, non-prefetchable) [size=16K]
Capabilities: [c8] Power Management version 2
Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 PME-Enable- DSel=0 DScale=1 PME-
Capabilities: [d0] Message Signalled Interrupts: Mask- 64bit+ Count=1/1 Enable-
Address: 0000000000000000 Data: 0000
Capabilities: [e0] Express (v1) Endpoint, MSI 00
DevCap:MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
DevCtl:Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
MaxPayload 128 bytes, MaxReadReq 512 bytes
DevSta:CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
LnkCap:Port #0, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <128ns, L1
<64us
ClockPM- Suprise- LLActRep- BwNot-
LnkCtl:ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta:Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt-
ABWMgmt-
Capabilities: [a0] MSI-X: Enable+ Mask- TabSize=5
Vector table: BAR=3 offset=00000000
PBA: BAR=3 offset=00002000
Capabilities: [100] Advanced Error Reporting
UESta:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC-
UnsupReq- ACSVoil-
UEMsk:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC-
UnsupReq- ACSVoil-
UESvrt:DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC-
UnsupReq- ACSVoil-
CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
AERCap:First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
Capabilities: [140] Device Serial Number 85-4f-f0-ff-ff-9b-ca-70
Kernel driver in use: e1000e
Kernel modules: e1000e, e1000-cids
exec: /sbin/lspci -s 11:0.0 -vvv
11:00.0 Class 0200: Device 8086:10d3
Subsystem: Device 8086:0000
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping-
SERR- FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
<MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 16
Region 0: Memory at dcbe0000 (32-bit, non-prefetchable) [size=128K]
Region 2: I/O ports at bce0 [size=32]
Region 3: Memory at dcbdc000 (32-bit, non-prefetchable) [size=16K]
Capabilities: [c8] Power Management version 2
Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 PME-Enable- DSel=0 DScale=1 PME-
Capabilities: [d0] Message Signalled Interrupts: Mask- 64bit+ Count=1/1 Enable-
Address: 0000000000000000 Data: 0000
Capabilities: [e0] Express (v1) Endpoint, MSI 00
DevCap:MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
DevCtl:Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
MaxPayload 128 bytes, MaxReadReq 512 bytes
DevSta:CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
LnkCap:Port #0, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <128ns, L1
<64us
ClockPM- Suprise- LLActRep- BwNot-
LnkCtl:ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta:Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt-
ABWMgmt-
Capabilities: [a0] MSI-X: Enable+ Mask- TabSize=5
Vector table: BAR=3 offset=00000000
PBA: BAR=3 offset=00002000
Capabilities: [100] Advanced Error Reporting
UESta:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC-
UnsupReq- ACSVoil-
UEMsk:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC-
UnsupReq- ACSVoil-
UESvrt:DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC-
UnsupReq- ACSVoil-
CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
AERCap:First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
Capabilities: [140] Device Serial Number 84-4f-f0-ff-ff-9b-ca-70
Kernel driver in use: e1000e
Kernel modules: e1000e, e1000-cids
exec: /sbin/lspci -s 12:1.0 -vvv
12:01.0 Class 0604: Device 10b5:8112 (rev aa)
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping-
SERR- FastB2B- DisINTx-
Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort-
<MAbort- >SERR- <PERR- INTx-
Latency: 32, Cache Line Size: 64 bytes
Region 0: Memory at dbcf0000 (64-bit, prefetchable) [size=64K]
Bus: primary=12, secondary=13, subordinate=16, sec-latency=32
I/O behind bridge: 0000f000-00000fff
Memory behind bridge: dc300000-dc8fffff
Prefetchable memory behind bridge: dbd00000-dc1fffff
Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
<MAbort+ <SERR- <PERR-
BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
Capabilities: [40] Power Management version 2
Flags: PMEClk- DSI- D1+ D2- AuxCurrent=0mA PME(D0+,D1+,D2-,D3hot+,D3cold-)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [50] Message Signalled Interrupts: Mask- 64bit+ Count=1/1 Enable-
Address: 0000000000000000 Data: 0000
Capabilities: [60] Express (v1) PCI/PCI-X to PCI-Express Bridge, MSI 00
DevCap:MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
ExtTag- RBE- FLReset-
DevCtl:Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop- BrConfRtry-
MaxPayload 128 bytes, MaxReadReq 512 bytes
DevSta:CorrErr+ UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
LnkCap:Port #0, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <1us, L1 <16us
ClockPM- Suprise- LLActRep- BwNot-
LnkCtl:ASPM Disabled; Disabled- Retrain- CommClk-
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta:Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk- DLActive- BWMgmt-
ABWMgmt-
CID Diagnostics Report END Mon May 20 21:58:51 UTC 2013
CLMBOH0001-IPS903# exit
On Tue, Jun 18, 2013 at 2:39 AM, Skidmore, Donald C
<[email protected]<mailto:[email protected]>> wrote:
Hi Kaushal,
Sorry about the troubles you're having with ixgbe. I was a bit confused by
what exactly you're seeing so let me ask you a few questions. When you say " I
see that out of 16 Rx Queues, only *One Queue* is dropping all the packets." is
that queue getting the majority of the traffic or the same load as the other
queues? I would be interesting to see how your interrupt were laid out (cat
/proc/interrupt | grep <ethX>)
As far as why MPC incrementing this can happen due to two reasons. First we
ran out of space in descriptor ring for the packet, this doesn't seem to be
your case as you checked to make sure the ring was empty. Next we could be
running on of bandwidth on the PCIe bus. This might be possible if all your
traffic was going to just one queue, but it would be worthwhile to see what the
connectivity looks like anyway (lspci -vvv)
It is also worth noting that your driver is quite old 2.0.38.3. I would
suggest at least trying the latest driver from source forge (currently 3.15.1).
https://sourceforge.net/projects/e1000/files/ixgbe%20stable/
I would also like to see if anything is being logged while this occurs (dmesg).
Thanks,
-Don Skidmore <[email protected]<mailto:[email protected]>>
> -----Original Message-----
> From: Kaushal Bhandankar
> [mailto:[email protected]<mailto:[email protected]>]
> Sent: Sunday, June 16, 2013 12:32 PM
> To:
> [email protected]<mailto:[email protected]>
> Subject: Re: [E1000-devel] Intel 82599 Driver dropping packets Queue
> Receive Descriptor Head
>
> -bash-3.2$ /home/service/ethtool_x64 -i po0_0
> driver: tun
> version: 1.6
> firmware-version: N/A
> bus-info: tap
> supports-statistics: no
> supports-test: no
> supports-eeprom-access: no
> supports-register-dump: no
>
>
> -bash-3.2# modinfo ixgbe
> filename:
> /lib/modules/2.6.29.1/kernel/drivers/net/ixgbe/ixgbe.ko<http://2.6.29.1/kernel/drivers/net/ixgbe/ixgbe.ko>
> version: 2.0.38.3-NAPI
> license: GPL
> description: Intel(R) 10 Gigabit PCI Express Network Driver
> author: Intel Corporation,
> <[email protected]<mailto:[email protected]>>
> srcversion: CF158600678C3ADC41F341A
> alias: pci:v00008086d000010FBsv*sd*bc*sc*i*
> alias: pci:v00008086d000010FCsv*sd*bc*sc*i*
> alias: pci:v00008086d000010F7sv*sd*bc*sc*i*
> alias: pci:v00008086d000010DBsv*sd*bc*sc*i*
> alias: pci:v00008086d000010F4sv*sd*bc*sc*i*
> alias: pci:v00008086d000010E1sv*sd*bc*sc*i*
> alias: pci:v00008086d000010F1sv*sd*bc*sc*i*
> alias: pci:v00008086d000010ECsv*sd*bc*sc*i*
> alias: pci:v00008086d000010DDsv*sd*bc*sc*i*
> alias: pci:v00008086d0000150Bsv*sd*bc*sc*i*
> alias: pci:v00008086d000010C8sv*sd*bc*sc*i*
> alias: pci:v00008086d000010C7sv*sd*bc*sc*i*
> alias: pci:v00008086d000010C6sv*sd*bc*sc*i*
> alias: pci:v00008086d00001508sv*sd*bc*sc*i*
> alias: pci:v00008086d000010B6sv*sd*bc*sc*i*
> depends:
> vermagic: 2.6.29.1 SMP mod_unload
> parm: InterruptType:Change Interrupt Mode (0=Legacy, 1=MSI,
> 2=MSI-X), default 2 (array of int)
> parm: MQ:Disable or enable Multiple Queues, default 1 (array of
> int)
> parm: DCA:Disable or enable Direct Cache Access, 0=disabled,
> 1=descriptor only, 2=descriptor and data (array of int)
> parm: RSS:Number of Receive-Side Scaling Descriptor Queues,
> default 1=number of cpus (array of int)
> parm: InterruptThrottleRate:Maximum interrupts per second, per
> vector, (956-488281), default 8000 (array of int)
> parm: LLIPort:Low Latency Interrupt TCP Port (0-65535) (array of
> int)
> parm: LLIPush:Low Latency Interrupt on TCP Push flag (0,1) (array
> of int)
> parm: LLISize:Low Latency Interrupt on Packet Size (0-1500)
> (array of int)
> parm: LLIEType:Low Latency Interrupt Ethernet Protocol Type
> (array of int)
> parm: LLIVLANP:Low Latency Interrupt on VLAN priority threshold
> (array of int)
> parm: RxBufferMode:0=1 descriptor per packet,
> 1=use packet split, multiple descriptors per jumbo
> frame
> 2 (default)=use 1buf mode for 1500 mtu, packet split
> for jumbo
> (array of int)
> parm: FdirMode:Flow Director filtering modes:
> 0 = Filtering off
> 1 = Signature Hashing filters (SW ATR)
> 2 = Perfect Filters (array of int)
> parm: FdirPballoc:Flow Director packet buffer allocation level:
> 0 = 8k hash filters or 2k perfect filters
> 1 = 16k hash filters or 4k perfect filters
> 2 = 32k hash filters or 8k perfect filters (array of
> int)
> parm: AtrSampleRate:Software ATR Tx packet sample rate (array of
> int)
> parm: DoubleVlan:Disable or enable double Vlan support, default 0
> (array of int)
> parm: InnerVlanMode:Disable or enable Inner Vlan stripping,
> default 0 (array of int)
>
>
>
> -bash-3.2# modprobe -l ixgbe
> /lib/modules/2.6.29.1/kernel/drivers/net/ixgbe/ixgbe.ko<http://2.6.29.1/kernel/drivers/net/ixgbe/ixgbe.ko>
>
> -bash-3.2# lsmod
> Module Size Used by
> cidmodcap 4208 16
> cpp_base 845040 8
> tipc 118392 2
> rebootkom 2468 0
> nf_conntrack_ipv4 13376 1
> nf_defrag_ipv4 1976 1 nf_conntrack_ipv4
> xt_state 2232 1
> nf_conntrack 60000 2 nf_conntrack_ipv4,xt_state
> iptable_filter 2888 1
> ip_tables 15848 1 iptable_filter
> x_tables 18208 2 xt_state,ip_tables
> igb 76876 0
> e1000e 113256 0
> ixgbe 168116 0
> ihm 6252 2
> cids_shared 579704 0
> linux_user_bde 15624 0
> linux_kernel_bde 28816 1 linux_user_bde
> -bash-3.2#
>
>
> cat /proc/cpuinfo = 16 cores
>
>
>
>
> On Sun, Jun 16, 2013 at 10:04 AM, Kaushal Bhandankar
> <[email protected]<mailto:[email protected]>>wrote:
>
> > Hi,
> > I am using Intel 82599 driver in my product. I see that out of 16 Rx
> > Queues, only *One Queue* is dropping all the packets. When I did a
> > test *to en-queue packets only to the problematic Queue*, I found that
> > the
> >
> > -> Rx Missed Packet Count ( mpc ) is 0 Good Packet Received Count (
> > -> gprc ) in increased for received packets -
> > L2 filtering is pass.
> >
> > What may be the reason for this behavior ?
> >
> > For debug, I am also printing the "Queue Receive Descriptor Head" and
> > "Queue Receive Descriptor Tail" to get information about how many
> > descriptors are in-use. My question is, in further tests, if I find
> > that No Descriptor is in-use, however still packets are getting
> > dropped -- Can I infer Hardware Failure from it ?
> >
> > Regards,
> > Kaushal
> >
------------------------------------------------------------------------------
This SF.net email is sponsored by Windows:
Build for Windows Store.
http://p.sf.net/sfu/windows-dev2dev
_______________________________________________
E1000-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit
http://communities.intel.com/community/wired
