Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-25 Thread Shannon Nelson
On Tue, Mar 24, 2015 at 8:04 AM, jacob jacob wrote: > > The issue is running dpdk from within the vm itself. Is it possible > that the igb_uio driver needs additional updates/functionality to be > at parity with 1.2.37 version of i40e driver? > At this point I think you need to work with the DPDK

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-24 Thread jacob jacob
On Tue, Mar 24, 2015 at 10:53 AM, Shannon Nelson wrote: > On Tue, Mar 24, 2015 at 7:13 AM, jacob jacob wrote: >> After update to latest firmware and using version 1.2.37 of i40e >> driver, things are looking better with PCI passthrough. >> >> ]# ethtool -i eth3 >> driver: i40e >> version: 1.2.37

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-24 Thread Shannon Nelson
On Tue, Mar 24, 2015 at 7:13 AM, jacob jacob wrote: > After update to latest firmware and using version 1.2.37 of i40e > driver, things are looking better with PCI passthrough. > > ]# ethtool -i eth3 > driver: i40e > version: 1.2.37 > firmware-version: f4.33.31377 a1.2 n4.42 e1930 > bus-info:

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-24 Thread jacob jacob
After update to latest firmware and using version 1.2.37 of i40e driver, things are looking better with PCI passthrough. ]# ethtool -i eth3 driver: i40e version: 1.2.37 firmware-version: f4.33.31377 a1.2 n4.42 e1930 bus-info: :00:07.0 supports-statistics: yes supports-test: yes supports-eeprom

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-23 Thread Stefan Assmann
On 20.03.2015 21:55, jacob jacob wrote: > On Thu, Mar 19, 2015 at 10:18 AM, Stefan Assmann wrote: >> On 19.03.2015 15:04, jacob jacob wrote: >>> Hi Stefan, >>> have you been able to get PCI passthrough working without any issues >>> after the upgrade? >> >> My XL710 fails to transfer regular TCP t

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-20 Thread jacob jacob
On Thu, Mar 19, 2015 at 10:18 AM, Stefan Assmann wrote: > On 19.03.2015 15:04, jacob jacob wrote: >> Hi Stefan, >> have you been able to get PCI passthrough working without any issues >> after the upgrade? > > My XL710 fails to transfer regular TCP traffic (netperf). If that works > for you then y

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-19 Thread jacob jacob
On Thu, Mar 19, 2015 at 5:53 PM, jacob jacob wrote: > On Thu, Mar 19, 2015 at 5:42 PM, Shannon Nelson > wrote: >> On Thu, Mar 19, 2015 at 2:04 PM, jacob jacob wrote: >>> I have updated to latest firmware and still no luck. >> >> [...] >> >>> [ 61.554132] i40e :00:06.0 eth2: the driver fail

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-19 Thread jacob jacob
On Thu, Mar 19, 2015 at 5:42 PM, Shannon Nelson wrote: > On Thu, Mar 19, 2015 at 2:04 PM, jacob jacob wrote: >> I have updated to latest firmware and still no luck. > > [...] > >> [ 61.554132] i40e :00:06.0 eth2: the driver failed to link >> because an unqualified module was detected. <

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-19 Thread Shannon Nelson
On Thu, Mar 19, 2015 at 2:04 PM, jacob jacob wrote: > I have updated to latest firmware and still no luck. [...] > [ 61.554132] i40e :00:06.0 eth2: the driver failed to link > because an unqualified module was detected. > [ 61.555331] IPv6: ADDRCONF(NETDEV_UP): e

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-19 Thread jacob jacob
I have updated to latest firmware and still no luck. ]# ethtool -i eth1 driver: i40e version: 1.2.37 firmware-version: f4.33.31377 a1.2 n4.42 e1930 bus-info: :00:05.0 supports-statistics: yes supports-test: yes supports-eeprom-access: yes supports-register-dump: yes supports-priv-flags: yes

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-19 Thread Shannon Nelson
On Thu, Mar 19, 2015 at 1:15 AM, Stefan Assmann wrote: > Interesting, the following might explain why my XL710 feels a bit > sketchy then. ;-) > # ethtool -i p4p1 > driver: i40e > version: 1.2.37-k > firmware-version: f4.22.26225 a1.1 n4.24 e12ef > Looks like the firmware on this NIC is even older

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-19 Thread Stefan Assmann
On 19.03.2015 15:04, jacob jacob wrote: > Hi Stefan, > have you been able to get PCI passthrough working without any issues > after the upgrade? My XL710 fails to transfer regular TCP traffic (netperf). If that works for you then you're already one step ahead of me. Afraid I can't help you there.

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-19 Thread jacob jacob
Hi Stefan, have you been able to get PCI passthrough working without any issues after the upgrade? Thanks Jacob On Thu, Mar 19, 2015 at 4:15 AM, Stefan Assmann wrote: > On 18.03.2015 23:06, Shannon Nelson wrote: >> On Wed, Mar 18, 2015 at 3:01 PM, Shannon Nelson >> wrote: >>> >>> >>> On Wed, Mar

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-19 Thread jacob jacob
I was going to try this on fedora 21...now not very sure if that makes much sense.. On Thu, Mar 19, 2015 at 4:15 AM, Stefan Assmann wrote: > On 18.03.2015 23:06, Shannon Nelson wrote: >> On Wed, Mar 18, 2015 at 3:01 PM, Shannon Nelson >> wrote: >>> >>> >>> On Wed, Mar 18, 2015 at 8:40 AM, jacob

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-19 Thread Stefan Assmann
On 18.03.2015 23:06, Shannon Nelson wrote: > On Wed, Mar 18, 2015 at 3:01 PM, Shannon Nelson > wrote: >> >> >> On Wed, Mar 18, 2015 at 8:40 AM, jacob jacob wrote: >>> >>> On Wed, Mar 18, 2015 at 11:24 AM, Bandan Das wrote: Actually, Stefan suggests that support for this card is still s

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-18 Thread Shannon Nelson
On Wed, Mar 18, 2015 at 3:01 PM, Shannon Nelson wrote: > > > On Wed, Mar 18, 2015 at 8:40 AM, jacob jacob wrote: > > > > On Wed, Mar 18, 2015 at 11:24 AM, Bandan Das wrote: > > > > > > Actually, Stefan suggests that support for this card is still sketchy > > > and your best bet is to try out net

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-18 Thread Shannon Nelson
On Wed, Mar 18, 2015 at 8:40 AM, jacob jacob wrote: > > On Wed, Mar 18, 2015 at 11:24 AM, Bandan Das wrote: > > > > Actually, Stefan suggests that support for this card is still sketchy > > and your best bet is to try out net-next > > http://git.kernel.org/cgit/linux/kernel/git/davem/net-next.git

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-18 Thread jacob jacob
On Wed, Mar 18, 2015 at 11:24 AM, Bandan Das wrote: > [Ccing netdev and Stefan] > Bandan Das writes: > >> jacob jacob writes: >> >>> On Mon, Mar 16, 2015 at 2:12 PM, Bandan Das wrote: jacob jacob writes: > I also see the following in dmesg in the VM. > > [0.095758] AC

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-18 Thread Bandan Das
[Ccing netdev and Stefan] Bandan Das writes: > jacob jacob writes: > >> On Mon, Mar 16, 2015 at 2:12 PM, Bandan Das wrote: >>> jacob jacob writes: >>> I also see the following in dmesg in the VM. [0.095758] ACPI: PCI Root Bridge [PCI0] (domain [bus 00-ff]) [0.0

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-16 Thread jacob jacob
On Mon, Mar 16, 2015 at 3:49 PM, Bandan Das wrote: > jacob jacob writes: > >> On Mon, Mar 16, 2015 at 2:12 PM, Bandan Das wrote: >>> jacob jacob writes: >>> I also see the following in dmesg in the VM. [0.095758] ACPI: PCI Root Bridge [PCI0] (domain [bus 00-ff]) [

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-16 Thread Bandan Das
jacob jacob writes: > On Mon, Mar 16, 2015 at 2:12 PM, Bandan Das wrote: >> jacob jacob writes: >> >>> I also see the following in dmesg in the VM. >>> >>> [0.095758] ACPI: PCI Root Bridge [PCI0] (domain [bus 00-ff]) >>> [0.096006] acpi PNP0A03:00: ACPI _OSC support notification fa

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-16 Thread jacob jacob
On Mon, Mar 16, 2015 at 2:12 PM, Bandan Das wrote: > jacob jacob writes: > >> I also see the following in dmesg in the VM. >> >> [0.095758] ACPI: PCI Root Bridge [PCI0] (domain [bus 00-ff]) >> [0.096006] acpi PNP0A03:00: ACPI _OSC support notification failed, >> disabling PCIe ASPM >

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-16 Thread Bandan Das
jacob jacob writes: > I also see the following in dmesg in the VM. > > [0.095758] ACPI: PCI Root Bridge [PCI0] (domain [bus 00-ff]) > [0.096006] acpi PNP0A03:00: ACPI _OSC support notification failed, > disabling PCIe ASPM > [0.096915] acpi PNP0A03:00: Unable to request _OSC cont

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-16 Thread jacob jacob
I also see the following in dmesg in the VM. [0.095758] ACPI: PCI Root Bridge [PCI0] (domain [bus 00-ff]) [0.096006] acpi PNP0A03:00: ACPI _OSC support notification failed, disabling PCIe ASPM [0.096915] acpi PNP0A03:00: Unable to request _OSC control (_OSC support mask: 0x08) [

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-13 Thread jacob jacob
> So, it could be the i40e driver then ? Because IIUC, VFs use a separate > driver. Just to rule out the possibility that there might be some driver > fixes that > could help with this, it might be a good idea to try a 3.19 or later upstream > kernel. > I tried with the latest DPDK release too (d

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-12 Thread Bandan Das
jacob jacob writes: > On Thu, Mar 12, 2015 at 3:07 PM, Bandan Das wrote: >> jacob jacob writes: >> >>> Hi, >>> >>> Seeing failures when trying to do PCI passthrough of Intel XL710 40G >>> interface to KVM vm. >>> 0a:00.1 Ethernet controller: Intel Corporation Ethernet >>> Controller XL71

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-12 Thread jacob jacob
On Thu, Mar 12, 2015 at 3:07 PM, Bandan Das wrote: > jacob jacob writes: > >> Hi, >> >> Seeing failures when trying to do PCI passthrough of Intel XL710 40G >> interface to KVM vm. >> 0a:00.1 Ethernet controller: Intel Corporation Ethernet >> Controller XL710 for 40GbE QSFP+ (rev 01) > > Y

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-12 Thread Bandan Das
jacob jacob writes: > Hi, > > Seeing failures when trying to do PCI passthrough of Intel XL710 40G > interface to KVM vm. > 0a:00.1 Ethernet controller: Intel Corporation Ethernet > Controller XL710 for 40GbE QSFP+ (rev 01) You are assigning the PF right ? Does assigning VFs work or it's

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-12 Thread jacob jacob
Hi Alex, Thanks for the response. I tried both pci-assign and vfio-pci. The issue is seen in both cases. i40e driver complains about data tx timeout. # libvirtd --version libvirtd (libvirt) 1.2.9.2 Name: qemu-system-x86 Arch: x86_64 Epoch : 2 Version : 2.1.3 Release

[Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-12 Thread jacob jacob
Hi, Seeing failures when trying to do PCI passthrough of Intel XL710 40G interface to KVM vm. 0a:00.1 Ethernet controller: Intel Corporation Ethernet Controller XL710 for 40GbE QSFP+ (rev 01) >From dmesg on host: [80326.559674] kvm: zapping shadow pages for mmio generation wraparound [80327.

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-12 Thread Alex Williamson
On Thu, 2015-03-12 at 12:17 -0400, jacob jacob wrote: > Hi, > > Seeing failures when trying to do PCI passthrough of Intel XL710 40G > interface to KVM vm. How is the device being assigned, pci-assign or vfio-pci? What QEMU version? What host kernel version? Thanks, Alex

Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-12 Thread jacob jacob
> > Hi, > > Seeing failures when trying to do PCI passthrough of Intel XL710 40G interface to KVM vm. > 0a:00.1 Ethernet controller: Intel Corporation Ethernet Controller XL710 for 40GbE QSFP+ (rev 01) > > From dmesg on host: > > [80326.559674] kvm: zapping shadow pages for mmio generation wrap

[Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM)

2015-03-12 Thread jacob jacob
Hi, Seeing failures when trying to do PCI passthrough of Intel XL710 40G interface to KVM vm. 0a:00.1 Ethernet controller: Intel Corporation Ethernet Controller XL710 for 40GbE QSFP+ (rev 01) >From dmesg on host: > [80326.559674] kvm: zapping shadow pages for mmio generation wraparound >