Re: [vfio-users] Ryzen Primary GPU passthrough success and woes

2017-04-03 Thread Graham Neville
Cheers for that. Added it to my config and set hugespaces via kernel command line. BOOT_IMAGE=/vmlinuz-linux root=UUID=bf69add2-e36f-453a-b92e-a4343ca20d26 rw quiet amd_iommu=on vfio-pci.ids=1002:67b1,1002:aac8 video=efifb:off isolcpus=0-9 kvm_amd.avic=1 hugepages=12188 I also set iothreads, but

Re: [vfio-users] vfio, xeon e3s, acs, & gpus -- oh my!

2017-04-03 Thread globalgorrilla
On 3 Apr 2017, at 10:21, globalgorri...@fastmail.fm wrote: On 3 Apr 2017, at 10:19, Steven Walter wrote: On Mon, Apr 3, 2017 at 1:08 PM, wrote: On 2 Apr 2017, at 0:10, Joshua Hoblitt wrote: I decided to go with an E6-1650 v4 / C612 based motherboard as I wanted both ECC memory and a BMC.

Re: [vfio-users] vfio, xeon e3s, acs, & gpus -- oh my!

2017-04-03 Thread globalgorrilla
On 3 Apr 2017, at 10:19, Steven Walter wrote: > On Mon, Apr 3, 2017 at 1:08 PM, wrote: >> On 2 Apr 2017, at 0:10, Joshua Hoblitt wrote: >> >>> I decided to go with an E6-1650 v4 / C612 based motherboard as I wanted >>> both ECC memory and a BMC. >> >> >> I think something this is the best option

Re: [vfio-users] vfio, xeon e3s, acs, & gpus -- oh my!

2017-04-03 Thread Steven Walter
On Mon, Apr 3, 2017 at 1:08 PM, wrote: > On 2 Apr 2017, at 0:10, Joshua Hoblitt wrote: > >> I decided to go with an E6-1650 v4 / C612 based motherboard as I wanted >> both ECC memory and a BMC. > > > I think something this is the best option for the moment. > > Posted-interrupts are only on E5 v4

Re: [vfio-users] Ryzen Primary GPU passthrough success and woes

2017-04-03 Thread globalgorrilla
Might perform better. Also, yes Hugepages might be helpful too. Also, would you mind observing whether interrupts are posted when the GPU is in use in pass-through? watch -d cat /proc/interrupts Look at the bottom for PIN (Posted-interrupt notification event) and PIW (Posted-interrupt wa

Re: [vfio-users] vfio, xeon e3s, acs, & gpus -- oh my!

2017-04-03 Thread globalgorrilla
On 2 Apr 2017, at 0:10, Joshua Hoblitt wrote: I decided to go with an E6-1650 v4 / C612 based motherboard as I wanted both ECC memory and a BMC. I think something this is the best option for the moment. Posted-interrupts are only on E5 v4 and Xeon-D. It makes a big difference with network c