Re: [edk2-devel] [BUG] Extremely slow boot times with CPU and GPU passthrough and host phys-bits > 40

2024-12-04 Thread mitchell.augustin via groups.io
> What does 'sudo lspci -v' print for the NPU on the host and in the guest? Guest VM lspci -v output ( https://pastebin.ubuntu.com/p/8SV9qPBJbS/ ) Host lspci -v output ( https://pastebin.ubuntu.com/p/YV4RTZwGMv/ ) Here's one of the host GPUs: 1b:00.0 3D controller: NVIDIA Corporation GH100 [H100

Re: [edk2-devel] [BUG] Extremely slow boot times with CPU and GPU passthrough and host phys-bits > 40

2024-11-26 Thread mitchell.augustin via groups.io
Thanks Gerd, > When hotplugging devices you might need the 'pref64-reserve=' property > for '-device pcie-root-port' to make the bridge window larger. Double thanks for this - it was exactly what I needed, and I am now able to get hotplug working on a VM where the GPUs weren't attached at boot.

Re: [edk2-devel] [BUG] Extremely slow boot times with CPU and GPU passthrough and host phys-bits > 40

2024-11-25 Thread mitchell.augustin via groups.io
Thanks. > That is extremely slow.  How does /proc/iomem look like?  Anything > overlapping the ECAM maybe? Slow and fast guests' and host's /proc/iomem outputs are attached. For the fast guest, I also included the mapping after a reboot with `pci=realloc pci=nocrs` set, since that is the confi

Re: [edk2-devel] [BUG] Extremely slow boot times with CPU and GPU passthrough and host phys-bits > 40

2024-11-23 Thread mitchell.augustin via groups.io
Hi again, I have a more specific version of a prior question: Is there some fw_cfg flag that would simply allow me to use the classic MMIO window, in effect keeping PlatformInfoHob->PcdPciMmio64Size and PlatformInfoHob->PcdPciMmio64Base set to what they would be with the PlatformDynamicMmioWindo

Re: [edk2-devel] [BUG] Extremely slow boot times with CPU and GPU passthrough and host phys-bits > 40

2024-11-22 Thread mitchell.augustin via groups.io
Thanks, Gerd. This result is unfortunately more confusing. When I force physbits=40 and virtual bits=48 via -cpu host,host-phys-bits=on,host-phys-bits-limit=40,la57=off, and set `pci=realloc pci=nocrs` (and I confirmed that I see "40 bits physical, 48 bits virtual" in the guest lscpu), I still

Re: [edk2-devel] [BUG] Extremely slow boot times with CPU and GPU passthrough and host phys-bits > 40

2024-11-21 Thread mitchell.augustin via groups.io
Thanks for the suggestions, Gerd. > '-global ICH9-LPC.acpi-pci-hotplug-with-bridge-support=off' Unfortunatly, this did not result in any change in boot time. > '-cpu $name,host-phys-bits=on,host-phys-bits-limit=$bits' -cpu host,host-phys-bits=on,host-phys-bits-limit=40 does result in the desire

Re: [edk2-devel] [BUG] Extremely slow boot times with CPU and GPU passthrough and host phys-bits > 40

2024-11-20 Thread mitchell.augustin via groups.io
> I'd suggest to also trim down the logging, it's quite excessive in the build > (apparently every single memory allocation is logged), that slows down the > boot process too. The slow boot times persist with the default log level as well. -=-=-=-=-=-=-=-=-=-=-=- Groups.io Links: You receive a

Re: [edk2-devel] [BUG] Extremely slow boot times with CPU and GPU passthrough and host phys-bits > 40

2024-11-20 Thread mitchell.augustin via groups.io
@Gerd > Do you also see the slowdown without the GPU in a otherwise identical guest configuration? No - without the GPUs, the entire boot process takes less than 30 seconds (which is true before and after the dynamic mmio window size patch ( https://github.com/tianocore/edk2/commit/ecb778d0ac62

Re: [edk2-devel] [BUG] Extremely slow boot times with CPU and GPU passthrough and host phys-bits > 40

2024-11-19 Thread mitchell.augustin via groups.io
Hi, Thanks for the suggestion. I'm not necessarily saying this patch itself has an issue, just that it is the point in the git history at which this slow boot time issue manifests for us. This may be because the patch does actually fix the other issue I described above related to BAR assignment