You have been subscribed to a public bug:
Hello,
We are testing network performance with SR-IOV on ubuntu and security
onion in Rhev Hypervisor. We are using a SuperMicro box running T-rex
traffic generator on CentOS which is connected to a gigamon to push
traffic to the Ubuntu/Security Onion VMs.
The ubuntu 16.04 vm is running on a RHVH host node and is running SR-
IOV. We have ensured that SR-IOV is enabled in the BIOS. We are finding
that packets stop coming into the interface after a few seconds. This is
because the interface is going down after a few seconds of receiving
traffic. We are running promiscuous mode and it is required for our use
case of measuring network traffic.
As a troubleshooting measure, 5.3.0-rc3 was built using the 3.2.3 iavf
SR-IOV driver. Note that the i40evf driver was renamed to iavf, which is
why the name discrepancy exists. After updating the Kernel we stopped
seeing this issue.
Non-working default security onion kernel information
root@ubuntu:~# uname -r
3.10.0-957.21.3.el7.x86_64
root@ubuntu:~# ethtool -i ens7
driver: iavf
version: 3.0.1-k
firmware-version: N/A
expansion-rom-version:
bus-info: 0000:00:07.0
supports-statistics: yes
supports-test: no
supports-eeprom-access: no
supports-register-dump: no
supports-priv-flags: yes
Working modified security onion kernel information
root@ubuntu:~# uname -r
5.3.0-rc3-custom
root@ubuntu:~# ethtool -i ens7
driver: i40evf
version: 3.2.3-k
firmware-version: N/A
expansion-rom-version:
bus-info: 0000:00:07.0
supports-statistics: yes
supports-test: no
supports-eeprom-access: no
supports-register-dump: no
supports-priv-flags: yes
We were able to perform testing using the 5.3.0 kernel, but long term a
better solution is needed as this would require supporting a modified
Linux kernel with updates, testing, etc.
>From the hypervisor in /var/log/messages:
Aug 27 09:05:00 localhost libvirtd: 2019-08-27 13:05:00.522+0000: 10748: error
: qemuDomainAgentAvailable:9133 : Guest agent is not responding:
QEMU guest agent is not connected
Aug 27 09:05:07 localhost goferd: [ERROR][worker-0]
gofer.messaging.adapter.conn ect:33 - connect:
proton+amqps://subscription.rhsm.redhat.com:5647, failed: Conn
ection amqps://subscription.rhsm.redhat.com:5647disconnected: Condition('amqp:r
esource-limit-exceeded', 'local-idle-timeout expired')
Aug 27 09:05:07 localhost goferd: [INFO][worker-0]
gofer.messaging.adapter.conne ct:35 - retry in 106 seconds
Aug 27 09:05:22 localhost kernel: i40e 0000:b5:00.3: Unable to send the message
to VF 0 aq_err 12
Aug 27 09:05:22 localhost kernel: i40e 0000:b5:00.3: Unable to send the message
to VF 0 aq_err 12
>From the VM, journalctl -xe gives:
-- The start-up result is done.
Aug 27 14:35:02 ubuntu kernel: i40evf 0000:00:04.0: PF reset warning received
Aug 27 14:35:02 ubuntu kernel: i40evf 0000:00:04.0: Scheduling reset task
Aug 27 14:35:03 ubuntu kernel: i40evf 0000:00:04.0: Hardware reset detected
Aug 27 14:35:03 ubuntu kernel: i40evf 0000:00:04.0: Hardware reset detected
Aug 27 14:35:03 ubuntu kernel: i40evf 0000:00:04.0: Hardware reset detected
Aug 27 14:35:08 ubuntu systemd-logind[1251]: Removed session 16.
-- Subject: Session 16 has been terminated
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- Documentation: http://www.freedesktop.org/wiki/Software/systemd/multiseat
** Affects: linux (Ubuntu)
Importance: Undecided
Status: New
** Tags: bot-comment
--
SR-IOV interface goes down when testing network performance
https://bugs.launchpad.net/bugs/1841669
You received this bug notification because you are a member of Kernel Packages,
which is subscribed to linux in Ubuntu.
--
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help : https://help.launchpad.net/ListHelp
