This is for passing through NVIDIA V100 GPUs on POWER9 systems. 7/7 and https://github.com/aik/linux/commit/f41f5666d27b31c1 have the details of hardware setup.
This implements support for NVIDIA V100 GPU with coherent memory and NPU/ATS support available in the POWER9 CPU. The aim is to support unmodified vendor driver in the guest. This is pushed to github: https://github.com/aik/qemu/tree/nv2-stage4 The host and guest kernel tree is pushed on github as well: https://github.com/aik/linux/tree/nv2-stage4 Skiboot bits are here: https://github.com/aik/skiboot/tree/nv2-stage4 Please comment. Thanks. Alexey Kardashevskiy (22): powerpc/ioda/npu: Call skiboot's hot reset hook when disabling NPU2 powerpc/mm/iommu/vfio_spapr_tce: Change mm_iommu_get to reference a region powerpc/mm/iommu: Make mm_iommu_new() fail on existing regions powerpc/vfio/iommu/kvm: Do not pin device memory powerpc/powernv/npu: Add helper to access struct npu for NPU device powerpc/powernv: Detach npu struct from pnv_phb powerpc/powernv/npu: Move OPAL calls away from context manipulation powerpc/pseries/iommu: Allow dynamic window to start from zero powerpc/pseries/iommu: Force default DMA window removal powerpc/pseries/iommu: Use memory@ nodes in max RAM address calculation powerpc/pseries/npu: Enable platform support powerpc/pseries: Remove IOMMU API support for non-LPAR systems powerpc/powernv/pseries: Rework device adding to IOMMU groups powerpc/iommu_api: Move IOMMU groups setup to a single place powerpc/powernv: Reference iommu_table while it is linked to a group powerpc/powernv: Add purge cache OPAL call powerpc/powernv/npu: Convert NPU IOMMU helpers to iommu_table_group_ops powerpc/powernv/npu: Add compound IOMMU groups powerpc/powernv/npu: Add release_ownership hook vfio_pci: Allow mapping extra regions vfio_pci: Allow regions to add own capabilities vfio_pci: Add NVIDIA GV100GL [Tesla V100 SXM2] [10de:1db1] subdriver drivers/vfio/pci/Makefile | 1 + arch/powerpc/include/asm/iommu.h | 17 +- arch/powerpc/include/asm/mmu_context.h | 9 +- arch/powerpc/include/asm/opal-api.h | 3 +- arch/powerpc/include/asm/opal.h | 1 + arch/powerpc/include/asm/pci.h | 4 + arch/powerpc/platforms/powernv/pci.h | 30 +- drivers/vfio/pci/trace.h | 102 ++++ drivers/vfio/pci/vfio_pci_private.h | 8 + include/uapi/linux/vfio.h | 26 + arch/powerpc/kernel/iommu.c | 67 +-- arch/powerpc/kvm/book3s_64_vio.c | 18 +- arch/powerpc/mm/mmu_context_iommu.c | 100 +++- arch/powerpc/platforms/powernv/npu-dma.c | 531 +++++++++++++++--- arch/powerpc/platforms/powernv/opal.c | 1 + arch/powerpc/platforms/powernv/pci-ioda-tce.c | 3 +- arch/powerpc/platforms/powernv/pci-ioda.c | 229 ++++---- arch/powerpc/platforms/powernv/pci.c | 43 +- arch/powerpc/platforms/pseries/iommu.c | 134 +++-- arch/powerpc/platforms/pseries/pci.c | 6 + drivers/vfio/pci/vfio_pci.c | 54 +- drivers/vfio/pci/vfio_pci_nvlink2.c | 433 ++++++++++++++ drivers/vfio/vfio_iommu_spapr_tce.c | 65 ++- .../powerpc/platforms/powernv/opal-wrappers.S | 1 + drivers/vfio/pci/Kconfig | 6 + 25 files changed, 1497 insertions(+), 395 deletions(-) create mode 100644 drivers/vfio/pci/trace.h create mode 100644 drivers/vfio/pci/vfio_pci_nvlink2.c -- 2.17.1
