There is a thread going on to implmenet statistics in tun/tap interface.
Looks promising. https://patchwork.kernel.org/patch/2579861/
On Tue, Jun 18, 2013 at 7:34 PM, Kaushal Bhandankar <[email protected]>wrote:
> This is a tap interface, Can't get register dump or statistics.
>
> -bash-3.2$ /home/service/ethtool_x64 -i po0_0
> driver: tun
> version: 1.6
> firmware-version: N/A
> bus-info: tap
> supports-statistics: no
> supports-test: no
> supports-eeprom-access: no
> supports-register-dump: no
>
>
> On Tue, Jun 18, 2013 at 7:00 PM, Ronciak, John <[email protected]>wrote:
>
>> Are the packets being dropped by the HW or by the SW somewhere? Read the
>> actual HW stats using ethtool to see if the HW is seeing all the packets.
>>
>> Thanks.
>>
>> Cheers,
>> John
>>
>>
>> > -----Original Message-----
>> > From: Kaushal Bhandankar [mailto:[email protected]]
>> > Sent: Monday, June 17, 2013 7:32 PM
>> > To: Skidmore, Donald C
>> > Cc: [email protected]
>> > Subject: Re: [E1000-devel] Intel 82599 Driver dropping packets Queue
>> > Receive Descriptor Head
>> >
>> > Thanks for the reply. I ll elaborate the issue we are seeing.
>> > When the affected queue started dropping packets, it had received 50%
>> > of traffic comapred to any other queue which was working fine. After
>> > this the traffic was diverted to another box. With no traffic in the
>> > Box, the affected Queue drops 100 % packets it sees. We do not use
>> > interrupt mechanism in our case. The Niantic hardware nic calculates
>> > the hash and puts the packet in the appropriate queue. The user
>> > Application directly read from this queue. There is no driver running
>> > in Kernel space. This is done to improve performance of the system.
>> > Also, We area creating a tap interface using ixgbe_tap_create call.
>> >
>> > =============
>> >
>> > -bash-3.2# dmesg
>> > q 15
>> > ide-gd driver 1.18
>> > Driver 'sd' needs updating - please use bus_type methods Driver 'sr'
>> > needs updating - please use bus_type methods
>> > ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver ehci_hcd
>> > 0000:00:1a.7: PCI INT C -> GSI 18 (level, low) -> IRQ 18 ehci_hcd
>> > 0000:00:1a.7: setting latency timer to 64 ehci_hcd 0000:00:1a.7: EHCI
>> > Host Controller ehci_hcd 0000:00:1a.7: new USB bus registered, assigned
>> > bus number 1 ehci_hcd 0000:00:1a.7: debug port 1 ehci_hcd 0000:00:1a.7:
>> > cache line size of 32 is not supported ehci_hcd 0000:00:1a.7: irq 18,
>> > io mem 0xdbbde000 ehci_hcd 0000:00:1a.7: USB 2.0 started, EHCI 1.00 usb
>> > usb1: configuration #1 chosen from 1 choice hub 1-0:1.0: USB hub found
>> > hub 1-0:1.0: 6 ports detected ehci_hcd 0000:00:1d.7: PCI INT A -> GSI
>> > 16 (level, low) -> IRQ 16 ehci_hcd 0000:00:1d.7: setting latency timer
>> > to 64 ehci_hcd 0000:00:1d.7: EHCI Host Controller ehci_hcd
>> > 0000:00:1d.7: new USB bus registered, assigned bus number 2 ehci_hcd
>> > 0000:00:1d.7: debug port 1 ehci_hcd 0000:00:1d.7: cache line size of 32
>> > is not supported ehci_hcd 0000:00:1d.7: irq 16, io mem 0xdbbdf000
>> > ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00 usb usb2:
>> > configuration #1 chosen from 1 choice hub 2-0:1.0: USB hub found hub 2-
>> > 0:1.0: 6 ports detected
>> > ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
>> > uhci_hcd: USB Universal Host Controller Interface driver uhci_hcd
>> > 0000:00:1a.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16 uhci_hcd
>> > 0000:00:1a.0: setting latency timer to 64 uhci_hcd 0000:00:1a.0: UHCI
>> > Host Controller uhci_hcd 0000:00:1a.0: new USB bus registered, assigned
>> > bus number 3 uhci_hcd 0000:00:1a.0: irq 16, io base 0x0000ac20 usb
>> > usb3: configuration #1 chosen from 1 choice hub 3-0:1.0: USB hub found
>> > hub 3-0:1.0: 2 ports detected uhci_hcd 0000:00:1a.1: PCI INT B -> GSI
>> > 17 (level, low) -> IRQ 17 uhci_hcd 0000:00:1a.1: setting latency timer
>> > to 64 uhci_hcd 0000:00:1a.1: UHCI Host Controller uhci_hcd
>> > 0000:00:1a.1: new USB bus registered, assigned bus number 4 uhci_hcd
>> > 0000:00:1a.1: irq 17, io base 0x0000ac40 usb usb4: configuration #1
>> > chosen from 1 choice hub 4-0:1.0: USB hub found hub 4-0:1.0: 2 ports
>> > detected uhci_hcd 0000:00:1a.2: PCI INT C -> GSI 18 (level, low) -> IRQ
>> > 18 uhci_hcd 0000:00:1a.2: setting latency timer to 64 uhci_hcd
>> > 0000:00:1a.2: UHCI Host Controller uhci_hcd 0000:00:1a.2: new USB bus
>> > registered, assigned bus number 5 uhci_hcd 0000:00:1a.2: irq 18, io
>> > base 0x0000ac60 usb usb5: configuration #1 chosen from 1 choice hub 5-
>> > 0:1.0: USB hub found hub 5-0:1.0: 2 ports detected uhci_hcd
>> > 0000:00:1d.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16 uhci_hcd
>> > 0000:00:1d.0: setting latency timer to 64 uhci_hcd 0000:00:1d.0: UHCI
>> > Host Controller uhci_hcd 0000:00:1d.0: new USB bus registered, assigned
>> > bus number 6 uhci_hcd 0000:00:1d.0: irq 16, io base 0x0000ac80 usb
>> > usb6: configuration #1 chosen from 1 choice hub 6-0:1.0: USB hub found
>> > hub 6-0:1.0: 2 ports detected uhci_hcd 0000:00:1d.1: PCI INT B -> GSI
>> > 17 (level, low) -> IRQ 17 uhci_hcd 0000:00:1d.1: setting latency timer
>> > to 64 uhci_hcd 0000:00:1d.1: UHCI Host Controller uhci_hcd
>> > 0000:00:1d.1: new USB bus registered, assigned bus number 7 uhci_hcd
>> > 0000:00:1d.1: irq 17, io base 0x0000aca0 usb usb7: configuration #1
>> > chosen from 1 choice hub 7-0:1.0: USB hub found hub 7-0:1.0: 2 ports
>> > detected uhci_hcd 0000:00:1d.2: PCI INT C -> GSI 18 (level, low) -> IRQ
>> > 18 uhci_hcd 0000:00:1d.2: setting latency timer to 64 uhci_hcd
>> > 0000:00:1d.2: UHCI Host Controller uhci_hcd 0000:00:1d.2: new USB bus
>> > registered, assigned bus number 8 uhci_hcd 0000:00:1d.2: irq 18, io
>> > base 0x0000acc0 usb usb8: configuration #1 chosen from 1 choice hub 8-
>> > 0:1.0: USB hub found hub 8-0:1.0: 2 ports detected Initializing USB
>> > Mass Storage driver...
>> > usbcore: registered new interface driver usb-storage USB Mass Storage
>> > support registered.
>> > PNP: No PS/2 controller found. Probing ports directly.
>> > i8042.c: No controller found.
>> > mice: PS/2 mouse device common for all mice rtc_cmos 00:09: RTC can
>> > wake from S4 rtc_cmos 00:09: rtc core: registered rtc_cmos as rtc0
>> > rtc0: alarms up to one day, 114 bytes nvram i2c /dev entries driver
>> > i801_smbus 0000:00:1f.3: PCI INT C -> GSI 18 (level, low) -> IRQ 18
>> > device-mapper: ioctl: 4.14.0-ioctl (2008-04-23) initialised:
>> > [email protected]
>> > cpuidle: using governor ladder
>> > ioatdma 0000:00:16.0: can't derive routing for PCI INT A ioatdma
>> > 0000:00:16.0: PCI INT A: no GSI ioatdma 0000:00:16.0: setting latency
>> > timer to 64 ioatdma 0000:00:16.0: Intel(R) I/OAT DMA Engine found, 1
>> > channels, device version 0x30, driver version 3.64 ioatdma
>> > 0000:00:16.0: irq 68 for MSI/MSI-X ioatdma 0000:00:16.0: DCA is
>> > disabled in BIOS ioatdma 0000:00:16.1: can't derive routing for PCI INT
>> > B ioatdma 0000:00:16.1: PCI INT B: no GSI ioatdma 0000:00:16.1: setting
>> > latency timer to 64 ioatdma 0000:00:16.1: Intel(R) I/OAT DMA Engine
>> > found, 1 channels, device version 0x30, driver version 3.64 ioatdma
>> > 0000:00:16.1: irq 69 for MSI/MSI-X ioatdma 0000:00:16.1: DCA is
>> > disabled in BIOS ioatdma 0000:00:16.2: can't derive routing for PCI INT
>> > C ioatdma 0000:00:16.2: PCI INT C: no GSI ioatdma 0000:00:16.2: setting
>> > latency timer to 64 ioatdma 0000:00:16.2: Intel(R) I/OAT DMA Engine
>> > found, 1 channels, device version 0x30, driver version 3.64 ioatdma
>> > 0000:00:16.2: irq 70 for MSI/MSI-X Clocksource tsc unstable (delta =
>> > 4687261807 ns) usb 1-4: new high speed USB device using ehci_hcd and
>> > address 2 ioatdma 0000:00:16.2: DCA is disabled in BIOS ioatdma
>> > 0000:00:16.3: can't derive routing for PCI INT D ioatdma 0000:00:16.3:
>> > PCI INT D: no GSI ioatdma 0000:00:16.3: setting latency timer to 64
>> > ioatdma 0000:00:16.3: Intel(R) I/OAT DMA Engine found, 1 channels,
>> > device version 0x30, driver version 3.64 ioatdma 0000:00:16.3: irq 71
>> > for MSI/MSI-X ioatdma 0000:00:16.3: DCA is disabled in BIOS ioatdma
>> > 0000:00:16.4: can't derive routing for PCI INT A ioatdma 0000:00:16.4:
>> > PCI INT A: no GSI ioatdma 0000:00:16.4: setting latency timer to 64
>> > ioatdma 0000:00:16.4: Intel(R) I/OAT DMA Engine found, 1 channels,
>> > device version 0x30, driver version 3.64 ioatdma 0000:00:16.4: irq 72
>> > for MSI/MSI-X usb 1-4: configuration #1 chosen from 1 choice
>> > scsi0 : SCSI emulation for USB Mass Storage devices ioatdma
>> > 0000:00:16.4: DCA is disabled in BIOS ioatdma 0000:00:16.5: can't
>> > derive routing for PCI INT B ioatdma 0000:00:16.5: PCI INT B: no GSI
>> > ioatdma 0000:00:16.5: setting latency timer to 64 ioatdma 0000:00:16.5:
>> > Intel(R) I/OAT DMA Engine found, 1 channels, device version 0x30,
>> > driver version 3.64 ioatdma 0000:00:16.5: irq 73 for MSI/MSI-X ioatdma
>> > 0000:00:16.5: DCA is disabled in BIOS ioatdma 0000:00:16.6: can't
>> > derive routing for PCI INT C ioatdma 0000:00:16.6: PCI INT C: no GSI
>> > ioatdma 0000:00:16.6: setting latency timer to 64 ioatdma 0000:00:16.6:
>> > Intel(R) I/OAT DMA Engine found, 1 channels, device version 0x30,
>> > driver version 3.64 ioatdma 0000:00:16.6: irq 74 for MSI/MSI-X ioatdma
>> > 0000:00:16.6: DCA is disabled in BIOS ioatdma 0000:00:16.7: can't
>> > derive routing for PCI INT D ioatdma 0000:00:16.7: PCI INT D: no GSI
>> > ioatdma 0000:00:16.7: setting latency timer to 64 ioatdma 0000:00:16.7:
>> > Intel(R) I/OAT DMA Engine found, 1 channels, device version 0x30,
>> > driver version 3.64 ioatdma 0000:00:16.7: irq 75 for MSI/MSI-X ioatdma
>> > 0000:00:16.7: DCA is disabled in BIOS
>> > usbcore: registered new interface driver usbhid
>> > usbhid: v2.6:USB HID core driver
>> > TCP cubic registered
>> > IPv6: Loaded, but is disabled by default. IPv6 may be enabled on
>> > individual interfaces.
>> > NET: Registered protocol family 10
>> > NET: Registered protocol family 17
>> > NET: Registered protocol family 5
>> > usb-storage: device found at 2
>> > usb-storage: waiting for device to settle before scanning rtc_cmos
>> > 00:09: setting system clock to 2013-04-24 08:30:08 UTC (1366792208)
>> > Freeing unused kernel memory: 1032k freed Write protecting the kernel
>> > read-only data: 4272k
>> > scsi 0:0:0:0: Direct-Access Unigen CEU2000 1100 PQ: 0
>> > ANSI:
>> > 0 CCS
>> > sd 0:0:0:0: [sda] 4014080 512-byte hardware sectors: (2.05 GB/1.91 GiB)
>> > sd 0:0:0:0: [sda] Write Protect is off sd 0:0:0:0: [sda] Mode Sense: 43
>> > 00 00 00 sd 0:0:0:0: [sda] Assuming drive cache: write through sd
>> > 0:0:0:0: [sda] 4014080 512-byte hardware sectors: (2.05 GB/1.91 GiB) sd
>> > 0:0:0:0: [sda] Write Protect is off sd 0:0:0:0: [sda] Mode Sense: 43 00
>> > 00 00 sd 0:0:0:0: [sda] Assuming drive cache: write through
>> > sda: sda1 sda2 sda3 sda4
>> > sd 0:0:0:0: [sda] Attached SCSI removable disk sd 0:0:0:0: Attached
>> > scsi generic sg0 type 0
>> > usb-storage: device scan complete
>> > kjournald starting. Commit interval 5 seconds
>> > EXT3-fs: mounted filesystem with ordered data mode.
>> > kjournald starting. Commit interval 5 seconds
>> > EXT3 FS on sda2, internal journal
>> > EXT3-fs: mounted filesystem with ordered data mode.
>> > kjournald starting. Commit interval 5 seconds
>> > EXT3-fs: mounted filesystem with ordered data mode.
>> > linux_kernel_bde: module license 'Proprietary' taints kernel.
>> > linux-kernel-bde 0000:12:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ
>> > 16 linux-kernel-bde (25599): ** Alloc contiguous DMA-able memroy
>> > 8388608 bytes =======> totalram(6148886) PAGE_SHIFT(12)
>> > blk_size(524288) order(7)
>> > PAGE_SIZE(4096)
>> > ==========> 24
>> > linux-kernel-bde (25599): alloc_mpool : dma_pbase (0xd7400000)
>> > dma_vbase
>> > (ffff8803d7400000)
>> > EXT3 FS on sda1, internal journal
>> > cpp INFO at cppInitBusDevice:862: Detected Tarari device 0, deviceId
>> > 0x0a05 on bus=11, slot=0 pci 0000:0b:00.0: PCI INT A -> GSI 16 (level,
>> > low) -> IRQ 16 pci 0000:0b:00.0: irq 76 for MSI/MSI-X
>> > IHM: Initializing Interface Helper Module
>> > IHM: registering chr device
>> > Module registered 248, from (pid 26094)
>> > Probe called with class 0x0
>> > Bus 8 Dev 0 Func 0
>> > ihm 0000:08:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16 ihm
>> > 0000:08:00.0: setting latency timer to 64 Probe called with class 0x0
>> > Bus 8 Dev 0 Func 1 ihm 0000:08:00.1: PCI INT B -> GSI 17 (level, low) -
>> > > IRQ 17 ihm 0000:08:00.1: setting latency timer to 64 Probe called
>> > with class 0x0 Bus 10 Dev 0 Func 0 ihm 0000:0a:00.0: PCI INT A -> GSI
>> > 16 (level, low) -> IRQ 16 ihm 0000:0a:00.0: setting latency timer to 64
>> > Probe called with class 0x0 Bus 10 Dev 0 Func 1 ihm 0000:0a:00.1: PCI
>> > INT B -> GSI 17 (level, low) -> IRQ 17 ihm 0000:0a:00.1: setting
>> > latency timer to 64
>> > ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version
>> > 2.0.38.3-NAPI Copyright (c) 1999-2009 Intel Corporation.
>> > IHM: Remove called
>> > ihm 0000:08:00.1: PCI INT B disabled
>> > ixgbe 0000:08:00.1: PCI INT B -> GSI 17 (level, low) -> IRQ 17 ixgbe
>> > 0000:08:00.1: enabling bus mastering ixgbe 0000:08:00.1: setting
>> > latency timer to 64
>> > ixgbe: 0000:08:00.1: ixgbe_check_options: Flow Director hash filtering
>> > enabled
>> > ixgbe: 0000:08:00.1: ixgbe_check_options: Flow Director allocated 64kB
>> > of packet buffer
>> > ixgbe: 0000:08:00.1: ixgbe_check_options: ATR Tx Packet sample rate set
>> > to default of 20 ixgbe 0000:08:00.1: irq 77 for MSI/MSI-X ixgbe
>> > 0000:08:00.1: irq 78 for MSI/MSI-X ixgbe 0000:08:00.1: irq 79 for
>> > MSI/MSI-X ixgbe 0000:08:00.1: irq 80 for MSI/MSI-X ixgbe 0000:08:00.1:
>> > irq 81 for MSI/MSI-X ixgbe 0000:08:00.1: irq 82 for MSI/MSI-X ixgbe
>> > 0000:08:00.1: irq 83 for MSI/MSI-X ixgbe 0000:08:00.1: irq 84 for
>> > MSI/MSI-X ixgbe 0000:08:00.1: irq 85 for MSI/MSI-X ixgbe 0000:08:00.1:
>> > irq 86 for MSI/MSI-X ixgbe 0000:08:00.1: irq 87 for MSI/MSI-X ixgbe
>> > 0000:08:00.1: irq 88 for MSI/MSI-X ixgbe 0000:08:00.1: irq 89 for
>> > MSI/MSI-X ixgbe 0000:08:00.1: irq 90 for MSI/MSI-X ixgbe 0000:08:00.1:
>> > irq 91 for MSI/MSI-X ixgbe 0000:08:00.1: irq 92 for MSI/MSI-X ixgbe
>> > 0000:08:00.1: irq 93 for MSI/MSI-X ixgbe 0000:08:00.1: irq 94 for
>> > MSI/MSI-X ixgbe 0000:08:00.1: irq 95 for MSI/MSI-X ixgbe 0000:08:00.1:
>> > irq 96 for MSI/MSI-X ixgbe 0000:08:00.1: irq 97 for MSI/MSI-X ixgbe
>> > 0000:08:00.1: irq 98 for MSI/MSI-X ixgbe 0000:08:00.1: irq 99 for
>> > MSI/MSI-X ixgbe 0000:08:00.1: irq 100 for MSI/MSI-X ixgbe 0000:08:00.1:
>> > irq 101 for MSI/MSI-X ixgbe 0000:08:00.1: irq 102 for MSI/MSI-X ixgbe
>> > 0000:08:00.1: irq 103 for MSI/MSI-X ixgbe 0000:08:00.1: irq 104 for
>> > MSI/MSI-X ixgbe 0000:08:00.1: irq 105 for MSI/MSI-X ixgbe 0000:08:00.1:
>> > irq 106 for MSI/MSI-X ixgbe 0000:08:00.1: irq 107 for MSI/MSI-X ixgbe
>> > 0000:08:00.1: irq 108 for MSI/MSI-X ixgbe 0000:08:00.1: irq 109 for
>> > MSI/MSI-X
>> > ixgbe: 0000:08:00.1: ixgbe_init_interrupt_scheme: Multiqueue Enabled:
>> > Rx Queue count = 16, Tx Queue count = 16
>> > ixgbe: 0000:08:00.1: ixgbe_probe: Double Vlan Mode not Enabled
>> > ixgbe: eth0: ixgbe_probe: No DCA provider found. Please start ioatdma
>> > for DCA functionality.
>> > ixgbe: eth0: ixgbe_probe: (PCI Express:5.0Gb/s:Width x8)
>> > 00:00:00:01:00:02
>> > ixgbe: eth0: ixgbe_probe: MAC: 2, PHY: 1, PBA No: ffffff-0ff
>> > ixgbe: eth0: ixgbe_probe: LRO is disabled
>> > ixgbe: eth0: ixgbe_probe: HW RSC is enabled
>> > ixgbe: eth0: ixgbe_probe: Intel(R) 10 Gigabit Network Connection
>> > IHM: Remove called
>> > ihm 0000:0a:00.0: PCI INT A disabled
>> > e1000e: Intel(R) PRO/1000 Network Driver - 0.3.3.3-k6
>> > e1000e: Copyright (c) 1999-2008 Intel Corporation.
>> > e1000e 0000:10:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16 e1000e
>> > 0000:10:00.0: setting latency timer to 64 e1000e 0000:10:00.0: irq 110
>> > for MSI/MSI-X e1000e 0000:10:00.0: irq 111 for MSI/MSI-X e1000e
>> > 0000:10:00.0: irq 112 for MSI/MSI-X
>> > 0000:10:00.0: eth1: (PCI Express:2.5GB/s:Width x1) 70:ca:9b:f0:4f:85
>> > 0000:10:00.0: eth1: Intel(R) PRO/1000 Network Connection
>> > 0000:10:00.0: eth1: MAC: 3, PHY: 8, PBA No: 1020ff-0ff e1000e
>> > 0000:11:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16 e1000e
>> > 0000:11:00.0: setting latency timer to 64 e1000e 0000:11:00.0: irq 113
>> > for MSI/MSI-X e1000e 0000:11:00.0: irq 114 for MSI/MSI-X e1000e
>> > 0000:11:00.0: irq 115 for MSI/MSI-X
>> > 0000:11:00.0: eth2: (PCI Express:2.5GB/s:Width x1) 70:ca:9b:f0:4f:84
>> > 0000:11:00.0: eth2: Intel(R) PRO/1000 Network Connection
>> > 0000:11:00.0: eth2: MAC: 3, PHY: 8, PBA No: 1020ff-0ff
>> > Intel(R) Gigabit Ethernet Network Driver - version 1.2.45-k2 Copyright
>> > (c) 2008 Intel Corporation.
>> > ip_tables: (C) 2000-2006 Netfilter Core Team nf_conntrack version 0.5.0
>> > (16384 buckets, 65536 max) CONFIG_NF_CT_ACCT is deprecated and will be
>> > removed soon. Please use
>> > nf_conntrack.acct=1 kernel paramater, acct=1 nf_conntrack module option
>> > or sysctl net.netfilter.nf_conntrack_acct=1 to enable it.
>> > ixgbe: sy0_0: ixgbe_watchdog_task: NIC Link is Up 10 Gbps, Flow
>> > Control:
>> > RX/TX
>> > ADDRCONF(NETDEV_UP): sy0_0: link is not ready
>> > ADDRCONF(NETDEV_CHANGE): sy0_0: link becomes ready
>> > TIPC: Activated (version 1.6.4 compiled Apr 24 2012 03:29:39)
>> > NET: Registered protocol family 30
>> > TIPC: Started in single node mode
>> > TIPC: Started in network mode
>> > TIPC: Own node address <1.1.2>, network identity 1234
>> > TIPC: Enabled bearer <eth:sy0_0>, discovery domain <1.1.0>, priority 10
>> > TIPC: Established link <1.1.2:sy0_0-1.1.1:tap0> on network plane A
>> > ADDRCONF(NETDEV_UP): ma0_0: link is not ready
>> > e1000e: ma0_0 NIC Link is Up 100 Mbps Full Duplex, Flow Control: None
>> > 0000:11:00.0: ma0_0: 10/100 speed: disabling TSO
>> > ADDRCONF(NETDEV_CHANGE): ma0_0: link becomes ready device po0_0 entered
>> > promiscuous mode device po0_0 left promiscuous mode device po0_0
>> > entered promiscuous mode device po0_0 left promiscuous mode device
>> > po0_0 entered promiscuous mode device po0_0 left promiscuous mode
>> > device po0_0 entered promiscuous mode device po0_0 left promiscuous
>> > mode device po0_0 entered promiscuous mode device po0_0 left
>> > promiscuous mode device po0_0 entered promiscuous mode device po0_0
>> > left promiscuous mode device po0_0 entered promiscuous mode device
>> > po0_0 left promiscuous mode device po0_0 entered promiscuous mode
>> > device po0_0 left promiscuous mode device po0_0 entered promiscuous
>> > mode device po0_0 left promiscuous mode -bash-3.2# su - cisco
>> > CLMBOH0001-IPS903# show int port
>> > portChannel portChannel0/0
>> > CLMBOH0001-IPS903# show int portChannel
>> > MAC statistics from interface PortChannel0/0
>> > Interface function = Sensing interface
>> > Description =
>> > Media Type = backplane
>> > Default Vlan = 0
>> > InlineMode = Unpaired
>> > Pair Status = N/A
>> > Hardware Bypass Capable = No
>> > Hardware Bypass Paired = N/A
>> > Link Status = Up
>> > Admin Enabled Status = Enabled
>> > Link Speed = Auto_10000
>> > Link Duplex = Auto_Full
>> > Missed Packet Percentage = 0
>> > Total Packets Received = 3479352341
>> > Total Bytes Received = 3963816352204
>> > Total Multicast Packets Received = 0
>> > Total Broadcast Packets Received = 0
>> > Total Jumbo Packets Received = 877491302
>> > Total Undersize Packets Received = 0
>> > Total Receive Errors = 2498336
>> > Total Receive FIFO Overruns = 0
>> > Total requests for buffer when none available = 0
>> > Total Packets Transmitted = 3479352325
>> > Total Bytes Transmitted = 3963816303436
>> > Total Multicast Packets Transmitted = 0
>> > Total Broadcast Packets Transmitted = 0
>> > Total Jumbo Packets Transmitted = 877491301
>> > Total Undersize Packets Transmitted = 0
>> > Total Transmit Errors = 0
>> > Total Transmit FIFO Overruns = 0
>> > CLMBOH0001-IPS903# exit
>> >
>> > ==================
>> >
>> > exec: /sbin/lspci -s 08:0.0 -vvv
>> > 08:00.0 Class 0200: Device 8086:10fc (rev 01)
>> > Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr-
>> > Stepping- SERR- FastB2B- DisINTx-
>> > Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
>> > <MAbort- >SERR- <PERR- INTx-
>> > Latency: 0, Cache Line Size: 64 bytes
>> > Interrupt: pin A routed to IRQ 16
>> > Region 0: Memory at decc0000 (64-bit, non-prefetchable) [size=128K]
>> > Region 2: I/O ports at fcc0 [size=32] Region 4: Memory at decb8000 (64-
>> > bit, non-prefetchable) [size=16K]
>> > Capabilities: [40] Power Management version 3
>> > Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-
>> > ,D3hot+,D3cold-)
>> > Status: D0 PME-Enable- DSel=0 DScale=1 PME-
>> > Capabilities: [50] Message Signalled Interrupts: Mask+ 64bit+ Count=1/1
>> > Enable-
>> > Address: 0000000000000000 Data: 0000
>> > Masking: 00000000 Pending: 00000000
>> > Capabilities: [70] MSI-X: Enable- Mask- TabSize=64 Vector table: BAR=4
>> > offset=00000000
>> > PBA: BAR=4 offset=00002000
>> > Capabilities: [a0] Express (v2) Endpoint, MSI 00 DevCap:MaxPayload 512
>> > bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
>> > ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ DevCtl:Report errors:
>> > Correctable- Non-Fatal- Fatal- Unsupported-
>> > RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
>> > MaxPayload 256 bytes, MaxReadReq 512 bytes DevSta:CorrErr+ UncorrErr-
>> > FatalErr- UnsuppReq+ AuxPwr- TransPend- LnkCap:Port #0, Speed 5GT/s,
>> > Width x8, ASPM L0s, Latency L0 unlimited, L1 <32us
>> > ClockPM- Suprise- LLActRep- BwNot-
>> > LnkCtl:ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
>> > ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- LnkSta:Speed 5GT/s,
>> > Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt-
>> > ABWMgmt-
>> > DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
>> > DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
>> > LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-,
>> > Selectable
>> > De-emphasis: -6dB
>> > Transmit Margin: Normal Operating Range, EnterModifiedCompliance-
>> > ComplianceSOS-
>> > Compliance De-emphasis: -6dB
>> > LnkSta2: Current De-emphasis Level: -6dB
>> > Capabilities: [e0] Vital Product Data <?>
>> > Capabilities: [100] Advanced Error Reporting
>> > UESta:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP-
>> > ECRC- UnsupReq- ACSVoil-
>> > UEMsk:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP-
>> > ECRC- UnsupReq- ACSVoil-
>> > UESvrt:DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+
>> > MalfTLP+
>> > ECRC- UnsupReq- ACSVoil-
>> > CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
>> > CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
>> > AERCap:First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
>> > Capabilities: [140] Device Serial Number 01-00-01-ff-ff-00-00-00
>> > Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
>> > ARICap:MFVC- ACS-, Next Function: 1
>> > ARICtl:MFVC- ACS-, Function Group: 0
>> > Capabilities: [160] Single Root I/O Virtualization (SR-IOV)
>> > IOVCap:Migration-, Interrupt Message Number: 000
>> > IOVCtl:Enable- Migration- Interrupt- MSE- ARIHierarchy-
>> > IOVSta:Migration-
>> > Initial VFs: 64, Total VFs: 64, Number of VFs: 0, Function Dependency
>> > Link:
>> > 00
>> > VF offset: 384, stride: 2, Device ID: 10ed Supported Page Size:
>> > 00000553, System Page Size: 00000001 VF Migration: offset: 00000000,
>> > BIR: 1 Kernel driver in use: ihm Kernel modules: ixgbe
>> > exec: /sbin/lspci -s 08:0.0 -vvv
>> > 08:00.0 Class 0200: Device 8086:10fc (rev 01)
>> > Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr-
>> > Stepping- SERR- FastB2B- DisINTx-
>> > Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
>> > <MAbort- >SERR- <PERR- INTx-
>> > Latency: 0, Cache Line Size: 64 bytes
>> > Interrupt: pin A routed to IRQ 16
>> > Region 0: Memory at decc0000 (64-bit, non-prefetchable) [size=128K]
>> > Region 2: I/O ports at fcc0 [size=32] Region 4: Memory at decb8000 (64-
>> > bit, non-prefetchable) [size=16K]
>> > Capabilities: [40] Power Management version 3
>> > Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-
>> > ,D3hot+,D3cold-)
>> > Status: D0 PME-Enable- DSel=0 DScale=1 PME-
>> > Capabilities: [50] Message Signalled Interrupts: Mask+ 64bit+ Count=1/1
>> > Enable-
>> > Address: 0000000000000000 Data: 0000
>> > Masking: 00000000 Pending: 00000000
>> > Capabilities: [70] MSI-X: Enable- Mask- TabSize=64 Vector table: BAR=4
>> > offset=00000000
>> > PBA: BAR=4 offset=00002000
>> > Capabilities: [a0] Express (v2) Endpoint, MSI 00 DevCap:MaxPayload 512
>> > bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
>> > ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ DevCtl:Report errors:
>> > Correctable- Non-Fatal- Fatal- Unsupported-
>> > RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
>> > MaxPayload 256 bytes, MaxReadReq 512 bytes DevSta:CorrErr+ UncorrErr-
>> > FatalErr- UnsuppReq+ AuxPwr- TransPend- LnkCap:Port #0, Speed 5GT/s,
>> > Width x8, ASPM L0s, Latency L0 unlimited, L1 <32us
>> > ClockPM- Suprise- LLActRep- BwNot-
>> > LnkCtl:ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
>> > ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- LnkSta:Speed 5GT/s,
>> > Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt-
>> > ABWMgmt-
>> > DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
>> > DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
>> > LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-,
>> > Selectable
>> > De-emphasis: -6dB
>> > Transmit Margin: Normal Operating Range, EnterModifiedCompliance-
>> > ComplianceSOS-
>> > Compliance De-emphasis: -6dB
>> > LnkSta2: Current De-emphasis Level: -6dB
>> > Capabilities: [e0] Vital Product Data <?>
>> > Capabilities: [100] Advanced Error Reporting
>> > UESta:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP-
>> > ECRC- UnsupReq- ACSVoil-
>> > UEMsk:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP-
>> > ECRC- UnsupReq- ACSVoil-
>> > UESvrt:DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+
>> > MalfTLP+
>> > ECRC- UnsupReq- ACSVoil-
>> > CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
>> > CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
>> > AERCap:First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
>> > Capabilities: [140] Device Serial Number 01-00-01-ff-ff-00-00-00
>> > Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
>> > ARICap:MFVC- ACS-, Next Function: 1
>> > ARICtl:MFVC- ACS-, Function Group: 0
>> > Capabilities: [160] Single Root I/O Virtualization (SR-IOV)
>> > IOVCap:Migration-, Interrupt Message Number: 000
>> > IOVCtl:Enable- Migration- Interrupt- MSE- ARIHierarchy-
>> > IOVSta:Migration-
>> > Initial VFs: 64, Total VFs: 64, Number of VFs: 0, Function Dependency
>> > Link:
>> > 00
>> > VF offset: 384, stride: 2, Device ID: 10ed Supported Page Size:
>> > 00000553, System Page Size: 00000001 VF Migration: offset: 00000000,
>> > BIR: 1 Kernel driver in use: ihm Kernel modules: ixgbe
>> > exec: /sbin/lspci -s 0a:0.0 -vvv
>> > 0a:00.0 Class 0200: Device 8086:10fc (rev 01)
>> > Control: I/O+ Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr-
>> > Stepping- SERR- FastB2B- DisINTx-
>> > Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
>> > <MAbort- >SERR- <PERR- INTx-
>> > Interrupt: pin A routed to IRQ 16
>> > Region 0: Memory at de5c0000 (64-bit, non-prefetchable) [size=128K]
>> > Region 2: I/O ports at ecc0 [size=32] Region 4: Memory at de5b8000 (64-
>> > bit, non-prefetchable) [size=16K]
>> > Capabilities: [40] Power Management version 3
>> > Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-
>> > ,D3hot+,D3cold-)
>> > Status: D0 PME-Enable- DSel=0 DScale=1 PME-
>> > Capabilities: [50] Message Signalled Interrupts: Mask+ 64bit+ Count=1/1
>> > Enable-
>> > Address: 0000000000000000 Data: 0000
>> > Masking: 00000000 Pending: 00000000
>> > Capabilities: [70] MSI-X: Enable- Mask- TabSize=64 Vector table: BAR=4
>> > offset=00000000
>> > PBA: BAR=4 offset=00002000
>> > Capabilities: [a0] Express (v2) Endpoint, MSI 00 DevCap:MaxPayload 512
>> > bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
>> > ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ DevCtl:Report errors:
>> > Correctable- Non-Fatal- Fatal- Unsupported-
>> > RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
>> > MaxPayload 256 bytes, MaxReadReq 512 bytes DevSta:CorrErr+ UncorrErr-
>> > FatalErr- UnsuppReq+ AuxPwr- TransPend- LnkCap:Port #0, Speed 5GT/s,
>> > Width x8, ASPM L0s, Latency L0 unlimited, L1 <32us
>> > ClockPM- Suprise- LLActRep- BwNot-
>> > LnkCtl:ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
>> > ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- LnkSta:Speed 5GT/s,
>> > Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt-
>> > ABWMgmt-
>> > DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
>> > DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
>> > LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-,
>> > Selectable
>> > De-emphasis: -6dB
>> > Transmit Margin: Normal Operating Range, EnterModifiedCompliance-
>> > ComplianceSOS-
>> > Compliance De-emphasis: -6dB
>> > LnkSta2: Current De-emphasis Level: -6dB
>> > Capabilities: [e0] Vital Product Data <?>
>> > Capabilities: [100] Advanced Error Reporting
>> > UESta:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP-
>> > ECRC- UnsupReq- ACSVoil-
>> > UEMsk:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP-
>> > ECRC- UnsupReq- ACSVoil-
>> > UESvrt:DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+
>> > MalfTLP+
>> > ECRC- UnsupReq- ACSVoil-
>> > CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
>> > CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
>> > AERCap:First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
>> > Capabilities: [140] Device Serial Number 03-00-01-ff-ff-00-00-00
>> > Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
>> > ARICap:MFVC- ACS-, Next Function: 1
>> > ARICtl:MFVC- ACS-, Function Group: 0
>> > Capabilities: [160] Single Root I/O Virtualization (SR-IOV)
>> > IOVCap:Migration-, Interrupt Message Number: 000
>> > IOVCtl:Enable- Migration- Interrupt- MSE- ARIHierarchy-
>> > IOVSta:Migration-
>> > Initial VFs: 64, Total VFs: 64, Number of VFs: 0, Function Dependency
>> > Link:
>> > 00
>> > VF offset: 384, stride: 2, Device ID: 10ed Supported Page Size:
>> > 00000553, System Page Size: 00000001 VF Migration: offset: 00000000,
>> > BIR: 1 Kernel modules: ixgbe
>> > exec: /sbin/lspci -s 09:0.0 -vvv
>> > exec: /sbin/lspci -s 0b:0.0 -vvv
>> > 0b:00.0 Class 0b40: Device 1000:0a05 (rev 01)
>> > Subsystem: Device 1000:0a0a
>> > Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr-
>> > Stepping- SERR- FastB2B- DisINTx+
>> > Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
>> > <MAbort- >SERR- <PERR- INTx-
>> > Latency: 0, Cache Line Size: 64 bytes
>> > Interrupt: pin A routed to IRQ 76
>> > Region 0: Memory at de200000 (64-bit, non-prefetchable) [size=1M]
>> > Capabilities: [40] Power Management version 3
>> > Flags: PMEClk- DSI- D1+ D2- AuxCurrent=375mA PME(D0+,D1+,D2-
>> > ,D3hot+,D3cold-)
>> > Status: D0 PME-Enable- DSel=0 DScale=0 PME-
>> > Capabilities: [50] Message Signalled Interrupts: Mask- 64bit+ Count=1/1
>> > Enable+
>> > Address: 00000000fee00000 Data: 409a
>> > Capabilities: [70] Express (v2) Endpoint, MSI 00 DevCap:MaxPayload 256
>> > bytes, PhantFunc 0, Latency L0s <128ns, L1 <2us
>> > ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset- DevCtl:Report errors:
>> > Correctable- Non-Fatal- Fatal- Unsupported-
>> > RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop-
>> > MaxPayload 128 bytes, MaxReadReq 256 bytes
>> > DevSta:CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend+
>> > LnkCap:Port #0, Speed 2.5GT/s, Width x8, ASPM L0s L1, Latency L0
>> > <512ns, L1 <64us
>> > ClockPM- Suprise- LLActRep- BwNot-
>> > LnkCtl:ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
>> > ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- LnkSta:Speed 2.5GT/s,
>> > Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt-
>> > ABWMgmt-
>> > DevCap2: Completion Timeout: Not Supported, TimeoutDis+
>> > DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
>> > LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-,
>> > Selectable
>> > De-emphasis: -6dB
>> > Transmit Margin: Normal Operating Range, EnterModifiedCompliance-
>> > ComplianceSOS-
>> > Compliance De-emphasis: -6dB
>> > LnkSta2: Current De-emphasis Level: -6dB
>> > Capabilities: [b0] MSI-X: Enable- Mask- TabSize=33 Vector table: BAR=0
>> > offset=00000000
>> > PBA: BAR=0 offset=00000000
>> > Capabilities: [100] Advanced Error Reporting
>> > UESta:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP-
>> > ECRC- UnsupReq- ACSVoil-
>> > UEMsk:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP-
>> > ECRC- UnsupReq- ACSVoil-
>> > UESvrt:DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+
>> > MalfTLP+
>> > ECRC- UnsupReq- ACSVoil-
>> > CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
>> > CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
>> > AERCap:First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
>> > Capabilities: [140] Virtual Channel <?>
>> > exec: /sbin/lspci -s 0c:0.0 -vvv
>> > 0c:00.0 Class 0100: Device 1000:0056 (rev 10)
>> > Subsystem: Device 1000:3180
>> > Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr-
>> > Stepping- SERR- FastB2B- DisINTx-
>> > Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
>> > <MAbort- >SERR- <PERR- INTx-
>> > Latency: 0, Cache Line Size: 64 bytes
>> > Interrupt: pin A routed to IRQ 5
>> > Region 0: I/O ports at dc00 [size=256]
>> > Region 1: Memory at dddec000 (64-bit, non-prefetchable) [size=16K]
>> > Region 3: Memory at dddf0000 (64-bit, non-prefetchable) [size=64K]
>> > Expansion ROM at dde00000 [disabled] [size=2M]
>> > Capabilities: [50] Power Management version 2
>> > Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-
>> > ,D3cold-)
>> > Status: D0 PME-Enable- DSel=0 DScale=0 PME-
>> > Capabilities: [68] Express (v1) Endpoint, MSI 00 DevCap:MaxPayload 4096
>> > bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
>> > ExtTag+ AttnBtn- AttnInd- PwrInd- RBE- FLReset-
>> > DevCtl:Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
>> > RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
>> > MaxPayload 128 bytes, MaxReadReq 512 bytes
>> > DevSta:CorrErr- UncorrErr+ FatalErr- UnsuppReq+ AuxPwr- TransPend-
>> > LnkCap:Port #0, Speed 2.5GT/s, Width x8, ASPM L0s L1, Latency L0 <64ns,
>> > L1 <1us
>> > ClockPM- Suprise- LLActRep- BwNot-
>> > LnkCtl:ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
>> > ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- LnkSta:Speed 2.5GT/s,
>> > Width x4, TrErr- Train- SlotClk- DLActive- BWMgmt-
>> > ABWMgmt-
>> > Capabilities: [98] Message Signalled Interrupts: Mask- 64bit+ Count=1/1
>> > Enable-
>> > Address: 0000000000000000 Data: 0000
>> > Capabilities: [b0] MSI-X: Enable- Mask- TabSize=1 Vector table: BAR=1
>> > offset=00002000
>> > PBA: BAR=1 offset=00003000
>> > Capabilities: [100] Advanced Error Reporting
>> > UESta:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP-
>> > ECRC- UnsupReq+ ACSVoil-
>> > UEMsk:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP-
>> > ECRC- UnsupReq- ACSVoil-
>> > UESvrt:DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+
>> > MalfTLP+
>> > ECRC- UnsupReq- ACSVoil-
>> > CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
>> > CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
>> > AERCap:First Error Pointer: 14, GenCap+ CGenEn- ChkCap+ ChkEn-
>> > exec: /sbin/lspci -s 10:0.0 -vvv
>> > 10:00.0 Class 0200: Device 8086:10d3
>> > Subsystem: Device 8086:0000
>> > Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr-
>> > Stepping- SERR- FastB2B- DisINTx+
>> > Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
>> > <MAbort- >SERR- <PERR- INTx-
>> > Latency: 0, Cache Line Size: 64 bytes
>> > Interrupt: pin A routed to IRQ 16
>> > Region 0: Memory at dcee0000 (32-bit, non-prefetchable) [size=128K]
>> > Region 2: I/O ports at cce0 [size=32] Region 3: Memory at dcedc000 (32-
>> > bit, non-prefetchable) [size=16K]
>> > Capabilities: [c8] Power Management version 2
>> > Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-
>> > ,D3hot+,D3cold+)
>> > Status: D0 PME-Enable- DSel=0 DScale=1 PME-
>> > Capabilities: [d0] Message Signalled Interrupts: Mask- 64bit+ Count=1/1
>> > Enable-
>> > Address: 0000000000000000 Data: 0000
>> > Capabilities: [e0] Express (v1) Endpoint, MSI 00 DevCap:MaxPayload 256
>> > bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
>> > ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset- DevCtl:Report errors:
>> > Correctable- Non-Fatal- Fatal- Unsupported-
>> > RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
>> > MaxPayload 128 bytes, MaxReadReq 512 bytes DevSta:CorrErr+ UncorrErr-
>> > FatalErr- UnsuppReq+ AuxPwr+ TransPend- LnkCap:Port #0, Speed 2.5GT/s,
>> > Width x1, ASPM L0s L1, Latency L0 <128ns, L1 <64us
>> > ClockPM- Suprise- LLActRep- BwNot-
>> > LnkCtl:ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
>> > ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- LnkSta:Speed 2.5GT/s,
>> > Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt-
>> > ABWMgmt-
>> > Capabilities: [a0] MSI-X: Enable+ Mask- TabSize=5 Vector table: BAR=3
>> > offset=00000000
>> > PBA: BAR=3 offset=00002000
>> > Capabilities: [100] Advanced Error Reporting
>> > UESta:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP-
>> > ECRC- UnsupReq- ACSVoil-
>> > UEMsk:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP-
>> > ECRC- UnsupReq- ACSVoil-
>> > UESvrt:DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+
>> > MalfTLP+
>> > ECRC- UnsupReq- ACSVoil-
>> > CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
>> > CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
>> > AERCap:First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
>> > Capabilities: [140] Device Serial Number 85-4f-f0-ff-ff-9b-ca-70 Kernel
>> > driver in use: e1000e Kernel modules: e1000e, e1000-cids
>> > exec: /sbin/lspci -s 11:0.0 -vvv
>> > 11:00.0 Class 0200: Device 8086:10d3
>> > Subsystem: Device 8086:0000
>> > Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr-
>> > Stepping- SERR- FastB2B- DisINTx+
>> > Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
>> > <MAbort- >SERR- <PERR- INTx-
>> > Latency: 0, Cache Line Size: 64 bytes
>> > Interrupt: pin A routed to IRQ 16
>> > Region 0: Memory at dcbe0000 (32-bit, non-prefetchable) [size=128K]
>> > Region 2: I/O ports at bce0 [size=32] Region 3: Memory at dcbdc000 (32-
>> > bit, non-prefetchable) [size=16K]
>> > Capabilities: [c8] Power Management version 2
>> > Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-
>> > ,D3hot+,D3cold+)
>> > Status: D0 PME-Enable- DSel=0 DScale=1 PME-
>> > Capabilities: [d0] Message Signalled Interrupts: Mask- 64bit+ Count=1/1
>> > Enable-
>> > Address: 0000000000000000 Data: 0000
>> > Capabilities: [e0] Express (v1) Endpoint, MSI 00 DevCap:MaxPayload 256
>> > bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
>> > ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset- DevCtl:Report errors:
>> > Correctable- Non-Fatal- Fatal- Unsupported-
>> > RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
>> > MaxPayload 128 bytes, MaxReadReq 512 bytes DevSta:CorrErr+ UncorrErr-
>> > FatalErr- UnsuppReq+ AuxPwr+ TransPend- LnkCap:Port #0, Speed 2.5GT/s,
>> > Width x1, ASPM L0s L1, Latency L0 <128ns, L1 <64us
>> > ClockPM- Suprise- LLActRep- BwNot-
>> > LnkCtl:ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
>> > ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- LnkSta:Speed 2.5GT/s,
>> > Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt-
>> > ABWMgmt-
>> > Capabilities: [a0] MSI-X: Enable+ Mask- TabSize=5 Vector table: BAR=3
>> > offset=00000000
>> > PBA: BAR=3 offset=00002000
>> > Capabilities: [100] Advanced Error Reporting
>> > UESta:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP-
>> > ECRC- UnsupReq- ACSVoil-
>> > UEMsk:DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP-
>> > ECRC- UnsupReq- ACSVoil-
>> > UESvrt:DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+
>> > MalfTLP+
>> > ECRC- UnsupReq- ACSVoil-
>> > CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
>> > CESta:RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
>> > AERCap:First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
>> > Capabilities: [140] Device Serial Number 84-4f-f0-ff-ff-9b-ca-70 Kernel
>> > driver in use: e1000e Kernel modules: e1000e, e1000-cids
>> > exec: /sbin/lspci -s 12:1.0 -vvv
>> > 12:01.0 Class 0604: Device 10b5:8112 (rev aa)
>> > Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr-
>> > Stepping- SERR- FastB2B- DisINTx-
>> > Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort-
>> > <TAbort-
>> > <MAbort- >SERR- <PERR- INTx-
>> > Latency: 32, Cache Line Size: 64 bytes
>> > Region 0: Memory at dbcf0000 (64-bit, prefetchable) [size=64K]
>> > Bus: primary=12, secondary=13, subordinate=16, sec-latency=32 I/O
>> > behind bridge: 0000f000-00000fff Memory behind bridge: dc300000-
>> > dc8fffff Prefetchable memory behind bridge: dbd00000-dc1fffff Secondary
>> > status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort+
>> > <SERR- <PERR-
>> > BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
>> > PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
>> > Capabilities: [40] Power Management version 2
>> > Flags: PMEClk- DSI- D1+ D2- AuxCurrent=0mA PME(D0+,D1+,D2-
>> > ,D3hot+,D3cold-)
>> > Status: D0 PME-Enable- DSel=0 DScale=0 PME-
>> > Capabilities: [50] Message Signalled Interrupts: Mask- 64bit+ Count=1/1
>> > Enable-
>> > Address: 0000000000000000 Data: 0000
>> > Capabilities: [60] Express (v1) PCI/PCI-X to PCI-Express Bridge, MSI 00
>> > DevCap:MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
>> > ExtTag- RBE- FLReset-
>> > DevCtl:Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
>> > RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop- BrConfRtry- MaxPayload 128
>> > bytes, MaxReadReq 512 bytes DevSta:CorrErr+ UncorrErr- FatalErr-
>> > UnsuppReq- AuxPwr- TransPend- LnkCap:Port #0, Speed 2.5GT/s, Width x1,
>> > ASPM L0s L1, Latency L0 <1us, L1 <16us
>> > ClockPM- Suprise- LLActRep- BwNot-
>> > LnkCtl:ASPM Disabled; Disabled- Retrain- CommClk-
>> > ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- LnkSta:Speed 2.5GT/s,
>> > Width x1, TrErr- Train- SlotClk- DLActive- BWMgmt-
>> > ABWMgmt-
>> > CID Diagnostics Report END Mon May 20 21:58:51 UTC 2013
>> >
>> >
>> >
>> > CLMBOH0001-IPS903# exit
>> >
>> >
>> > On Tue, Jun 18, 2013 at 2:39 AM, Skidmore, Donald C <
>> > [email protected]> wrote:
>> >
>> > > Hi Kaushal,
>> > >
>> > > Sorry about the troubles you're having with ixgbe. I was a bit
>> > > confused by what exactly you're seeing so let me ask you a few
>> > > questions. When you say " I see that out of 16 Rx Queues, only *One
>> > > Queue* is dropping all the packets." is that queue getting the
>> > > majority of the traffic or the same load as the other queues? I
>> > would
>> > > be interesting to see how your interrupt were laid out (cat
>> > > /proc/interrupt | grep <ethX>)
>> > >
>> > > As far as why MPC incrementing this can happen due to two reasons.
>> > > First we ran out of space in descriptor ring for the packet, this
>> > > doesn't seem to be your case as you checked to make sure the ring was
>> > > empty. Next we could be running on of bandwidth on the PCIe bus.
>> > > This might be possible if all your traffic was going to just one
>> > > queue, but it would be worthwhile to see what the connectivity looks
>> > > like anyway (lspci -vvv)
>> > >
>> > > It is also worth noting that your driver is quite old 2.0.38.3. I
>> > > would suggest at least trying the latest driver from source forge
>> > > (currently 3.15.1).
>> > > https://sourceforge.net/projects/e1000/files/ixgbe%20stable/
>> > >
>> > > I would also like to see if anything is being logged while this
>> > occurs
>> > > (dmesg).
>> > >
>> > > Thanks,
>> > > -Don Skidmore <[email protected]>
>> > >
>> > > > -----Original Message-----
>> > > > From: Kaushal Bhandankar [mailto:[email protected]]
>> > > > Sent: Sunday, June 16, 2013 12:32 PM
>> > > > To: [email protected]
>> > > > Subject: Re: [E1000-devel] Intel 82599 Driver dropping packets
>> > Queue
>> > > > Receive Descriptor Head
>> > > >
>> > > > -bash-3.2$ /home/service/ethtool_x64 -i po0_0
>> > > > driver: tun
>> > > > version: 1.6
>> > > > firmware-version: N/A
>> > > > bus-info: tap
>> > > > supports-statistics: no
>> > > > supports-test: no
>> > > > supports-eeprom-access: no
>> > > > supports-register-dump: no
>> > > >
>> > > >
>> > > > -bash-3.2# modinfo ixgbe
>> > > > filename:
>> > /lib/modules/2.6.29.1/kernel/drivers/net/ixgbe/ixgbe.ko
>> > > > version: 2.0.38.3-NAPI
>> > > > license: GPL
>> > > > description: Intel(R) 10 Gigabit PCI Express Network Driver
>> > > > author: Intel Corporation, <[email protected]>
>> > > > srcversion: CF158600678C3ADC41F341A
>> > > > alias: pci:v00008086d000010FBsv*sd*bc*sc*i*
>> > > > alias: pci:v00008086d000010FCsv*sd*bc*sc*i*
>> > > > alias: pci:v00008086d000010F7sv*sd*bc*sc*i*
>> > > > alias: pci:v00008086d000010DBsv*sd*bc*sc*i*
>> > > > alias: pci:v00008086d000010F4sv*sd*bc*sc*i*
>> > > > alias: pci:v00008086d000010E1sv*sd*bc*sc*i*
>> > > > alias: pci:v00008086d000010F1sv*sd*bc*sc*i*
>> > > > alias: pci:v00008086d000010ECsv*sd*bc*sc*i*
>> > > > alias: pci:v00008086d000010DDsv*sd*bc*sc*i*
>> > > > alias: pci:v00008086d0000150Bsv*sd*bc*sc*i*
>> > > > alias: pci:v00008086d000010C8sv*sd*bc*sc*i*
>> > > > alias: pci:v00008086d000010C7sv*sd*bc*sc*i*
>> > > > alias: pci:v00008086d000010C6sv*sd*bc*sc*i*
>> > > > alias: pci:v00008086d00001508sv*sd*bc*sc*i*
>> > > > alias: pci:v00008086d000010B6sv*sd*bc*sc*i*
>> > > > depends:
>> > > > vermagic: 2.6.29.1 SMP mod_unload
>> > > > parm: InterruptType:Change Interrupt Mode (0=Legacy,
>> > 1=MSI,
>> > > > 2=MSI-X), default 2 (array of int)
>> > > > parm: MQ:Disable or enable Multiple Queues, default 1
>> > (array of
>> > > > int)
>> > > > parm: DCA:Disable or enable Direct Cache Access,
>> > 0=disabled,
>> > > > 1=descriptor only, 2=descriptor and data (array of int)
>> > > > parm: RSS:Number of Receive-Side Scaling Descriptor
>> > Queues,
>> > > > default 1=number of cpus (array of int)
>> > > > parm: InterruptThrottleRate:Maximum interrupts per
>> > second, per
>> > > > vector, (956-488281), default 8000 (array of int)
>> > > > parm: LLIPort:Low Latency Interrupt TCP Port (0-65535)
>> > (array
>> > > of
>> > > > int)
>> > > > parm: LLIPush:Low Latency Interrupt on TCP Push flag
>> > (0,1)
>> > > (array
>> > > > of int)
>> > > > parm: LLISize:Low Latency Interrupt on Packet Size (0-
>> > 1500)
>> > > > (array of int)
>> > > > parm: LLIEType:Low Latency Interrupt Ethernet Protocol
>> > Type
>> > > > (array of int)
>> > > > parm: LLIVLANP:Low Latency Interrupt on VLAN priority
>> > threshold
>> > > > (array of int)
>> > > > parm: RxBufferMode:0=1 descriptor per packet,
>> > > > 1=use packet split, multiple descriptors
>> > per
>> > > jumbo frame
>> > > > 2 (default)=use 1buf mode for 1500 mtu,
>> > > > packet
>> > > split for jumbo
>> > > > (array of int)
>> > > > parm: FdirMode:Flow Director filtering modes:
>> > > > 0 = Filtering off
>> > > > 1 = Signature Hashing filters (SW ATR)
>> > > > 2 = Perfect Filters (array of int)
>> > > > parm: FdirPballoc:Flow Director packet buffer allocation
>> > level:
>> > > > 0 = 8k hash filters or 2k perfect filters
>> > > > 1 = 16k hash filters or 4k perfect filters
>> > > > 2 = 32k hash filters or 8k perfect filters
>> > > (array of int)
>> > > > parm: AtrSampleRate:Software ATR Tx packet sample rate
>> > (array
>> > > of
>> > > > int)
>> > > > parm: DoubleVlan:Disable or enable double Vlan support,
>> > > default 0
>> > > > (array of int)
>> > > > parm: InnerVlanMode:Disable or enable Inner Vlan
>> > stripping,
>> > > > default 0 (array of int)
>> > > >
>> > > >
>> > > >
>> > > > -bash-3.2# modprobe -l ixgbe
>> > > > /lib/modules/2.6.29.1/kernel/drivers/net/ixgbe/ixgbe.ko
>> > > >
>> > > > -bash-3.2# lsmod
>> > > > Module Size Used by
>> > > > cidmodcap 4208 16
>> > > > cpp_base 845040 8
>> > > > tipc 118392 2
>> > > > rebootkom 2468 0
>> > > > nf_conntrack_ipv4 13376 1
>> > > > nf_defrag_ipv4 1976 1 nf_conntrack_ipv4
>> > > > xt_state 2232 1
>> > > > nf_conntrack 60000 2 nf_conntrack_ipv4,xt_state
>> > > > iptable_filter 2888 1
>> > > > ip_tables 15848 1 iptable_filter
>> > > > x_tables 18208 2 xt_state,ip_tables
>> > > > igb 76876 0
>> > > > e1000e 113256 0
>> > > > ixgbe 168116 0
>> > > > ihm 6252 2
>> > > > cids_shared 579704 0
>> > > > linux_user_bde 15624 0
>> > > > linux_kernel_bde 28816 1 linux_user_bde
>> > > > -bash-3.2#
>> > > >
>> > > >
>> > > > cat /proc/cpuinfo = 16 cores
>> > > >
>> > > >
>> > > >
>> > > >
>> > > > On Sun, Jun 16, 2013 at 10:04 AM, Kaushal Bhandankar
>> > > > <[email protected]>wrote:
>> > > >
>> > > > > Hi,
>> > > > > I am using Intel 82599 driver in my product. I see that out of 16
>> > > > > Rx Queues, only *One Queue* is dropping all the packets. When I
>> > > > > did a test *to en-queue packets only to the problematic Queue*, I
>> > > > > found that the
>> > > > >
>> > > > > -> Rx Missed Packet Count ( mpc ) is 0 Good Packet Received Count
>> > > > > -> ( gprc ) in increased for received packets -
>> > > > > L2 filtering is pass.
>> > > > >
>> > > > > What may be the reason for this behavior ?
>> > > > >
>> > > > > For debug, I am also printing the "Queue Receive Descriptor Head"
>> > > > > and "Queue Receive Descriptor Tail" to get information about how
>> > > > > many descriptors are in-use. My question is, in further tests, if
>> > > > > I find that No Descriptor is in-use, however still packets are
>> > > > > getting dropped -- Can I infer Hardware Failure from it ?
>> > > > >
>> > > > > Regards,
>> > > > > Kaushal
>> > > > >
>> > >
>>
>
>
------------------------------------------------------------------------------
This SF.net email is sponsored by Windows:
Build for Windows Store.
http://p.sf.net/sfu/windows-dev2dev
_______________________________________________
E1000-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit
http://communities.intel.com/community/wired
