Public bug reported: When creating a KVM instance with an SR-IOV interface, the VM will be created but no interface is attached. Assuming from /var/log/kern.log it looks like it is failing during attaching VF. Following is the excerpt from the log, and
Oct 9 06:52:30 hyperconverge002-rack001 kernel: [71117.735178] VFIO - User Level meta-driver version: 0.3 Oct 9 06:52:31 hyperconverge002-rack001 kernel: [71118.221853] i40e 0000:af:00.1: Setting MAC fa:16:3e:18:53:cf on VF 62 Oct 9 06:52:31 hyperconverge002-rack001 kernel: [71118.426878] i40e 0000:af:00.1: Reload the VF driver to make this change effective. Oct 9 06:52:31 hyperconverge002-rack001 kernel: [71118.426933] i40e 0000:af:00.1: Setting VLAN 9, QOS 0x0 on VF 62 Oct 9 06:52:31 hyperconverge002-rack001 kernel: [71118.576429] audit: type=1400 audit(1570603951.429:104): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="libvirt-5d854c7a-d048-4c29-9eec-fa681fdca47a" pid=1598355 comm="apparmor_parser" Oct 9 06:52:31 hyperconverge002-rack001 kernel: [71118.722293] audit: type=1400 audit(1570603951.573:105): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="libvirt-5d854c7a-d048-4c29-9eec-fa681fdca47a" pid=1598358 comm="apparmor_parser" Oct 9 06:52:31 hyperconverge002-rack001 kernel: [71118.871748] audit: type=1400 audit(1570603951.725:106): apparmor="STATUS" operation="profile_replace" info="same as current profile, skipping" profile="unconfined" name="libvirt-5d854c7a-d048-4c29-9eec-fa681fdca47a" pid=1598361 comm="apparmor_parser" Oct 9 06:52:32 hyperconverge002-rack001 kernel: [71119.896031] vfio-pci 0000:af:11.6: enabling device (0000 -> 0002) Oct 9 06:52:32 hyperconverge002-rack001 kernel: [71120.007212] vfio-pci 0000:af:11.7: enabling device (0000 -> 0002) Oct 9 06:52:33 hyperconverge002-rack001 kernel: [71120.308116] i40e 0000:af:00.1: VF 62 still in reset. Try again. The last error says that the VF is still in reset state, and according to this[0], it looks like an race condition(wait 300ms for VF reset to complete) between attaching the VF and resetting the VF state. The environment, that is being used is: OpenStack Queens on Ubuntu Bionic kernel: 4.15.0-65-generic NIC: Intel X710 10GbE SFP+ driver: i40e v2.1.14-k [0] https://git.launchpad.net/~ubuntu- kernel/ubuntu/+source/linux/+git/bionic/tree/drivers/net/ethernet/intel/i40e/i40e_virtchnl_pf.c#n2916 ** Affects: linux (Ubuntu) Importance: Undecided Status: Confirmed ** Tags: cpe-onsite -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1847430 Title: Fails to attach VF to KVM instance Status in linux package in Ubuntu: Confirmed Bug description: When creating a KVM instance with an SR-IOV interface, the VM will be created but no interface is attached. Assuming from /var/log/kern.log it looks like it is failing during attaching VF. Following is the excerpt from the log, and Oct 9 06:52:30 hyperconverge002-rack001 kernel: [71117.735178] VFIO - User Level meta-driver version: 0.3 Oct 9 06:52:31 hyperconverge002-rack001 kernel: [71118.221853] i40e 0000:af:00.1: Setting MAC fa:16:3e:18:53:cf on VF 62 Oct 9 06:52:31 hyperconverge002-rack001 kernel: [71118.426878] i40e 0000:af:00.1: Reload the VF driver to make this change effective. Oct 9 06:52:31 hyperconverge002-rack001 kernel: [71118.426933] i40e 0000:af:00.1: Setting VLAN 9, QOS 0x0 on VF 62 Oct 9 06:52:31 hyperconverge002-rack001 kernel: [71118.576429] audit: type=1400 audit(1570603951.429:104): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="libvirt-5d854c7a-d048-4c29-9eec-fa681fdca47a" pid=1598355 comm="apparmor_parser" Oct 9 06:52:31 hyperconverge002-rack001 kernel: [71118.722293] audit: type=1400 audit(1570603951.573:105): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="libvirt-5d854c7a-d048-4c29-9eec-fa681fdca47a" pid=1598358 comm="apparmor_parser" Oct 9 06:52:31 hyperconverge002-rack001 kernel: [71118.871748] audit: type=1400 audit(1570603951.725:106): apparmor="STATUS" operation="profile_replace" info="same as current profile, skipping" profile="unconfined" name="libvirt-5d854c7a-d048-4c29-9eec-fa681fdca47a" pid=1598361 comm="apparmor_parser" Oct 9 06:52:32 hyperconverge002-rack001 kernel: [71119.896031] vfio-pci 0000:af:11.6: enabling device (0000 -> 0002) Oct 9 06:52:32 hyperconverge002-rack001 kernel: [71120.007212] vfio-pci 0000:af:11.7: enabling device (0000 -> 0002) Oct 9 06:52:33 hyperconverge002-rack001 kernel: [71120.308116] i40e 0000:af:00.1: VF 62 still in reset. Try again. The last error says that the VF is still in reset state, and according to this[0], it looks like an race condition(wait 300ms for VF reset to complete) between attaching the VF and resetting the VF state. The environment, that is being used is: OpenStack Queens on Ubuntu Bionic kernel: 4.15.0-65-generic NIC: Intel X710 10GbE SFP+ driver: i40e v2.1.14-k [0] https://git.launchpad.net/~ubuntu- kernel/ubuntu/+source/linux/+git/bionic/tree/drivers/net/ethernet/intel/i40e/i40e_virtchnl_pf.c#n2916 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1847430/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp