Thanks.
> That is extremely slow. How does /proc/iomem look like? Anything
> overlapping the ECAM maybe?
Slow and fast guests' and host's /proc/iomem outputs are attached. For the fast
guest, I also included the mapping after a reboot with `pci=realloc pci=nocrs`
set, since that is the config that actually allows the driver to load. I don't
see any regions labeled "PCI ECAM", not sure if that's an issue or if it might
just appear as something else on some configs.
> Could be in the guest, could also be the host (which creates the EPT page
> tables).
Noted. In any case, seems like an upstream report is warranted. I'll probably
start with kvm and vfio-pci lists.
> Rf the dynamic mmio window would be larger it will simply use the dynamic
> mmio window, otherwise the PcdPciMmio64Size + PcdPciMmio64Base values
Understood, seems like that wouldn't work for me to override dynamic behavior
then, since it appears that the window size that resulted in fast boot for us
was evidently smaller than what the dynamic MMIO window computes. (I'm basing
that off the fact that BARs fail to assign initially with the classic MMIO
window, but work later after recomputation caused by `pci=realloc`, whereas
they all get assigned correctly first try with the slow config.)
> Another way to check the boot time is to hot-plug the cards after booting
I tried this today as well. With and without `pci=realloc pci=nocrs`:
1. If I boot the slow config, where GPUs are passed through on boot, I can
unplug and hot-replug the GPUs, and it only takes a few seconds before they are
usable after re-plug, so that seems normal.
2. However, if I start the VM without the GPUs connected initially, while I can
hotplug them, their BARs fail to get assigned, and they are unusable. I tried
increasing the X-PciMmio64Mb knob up to the 16TB max, and also tried with
pci=realloc pci=nocrs pci=big_root_window in the guest, and also tried
removing/rescanning via /sys/bus/pci/devices/<addr>/remove and
/sys/bus/pci/rescan in the guest - none of these resulted in usable GPUs. I
also tried with pci=realloc,assign-busses and saw the same:
[ +0.002317] pci 0000:08:00.0: reg 0x10: [mem 0x00000000-0x00ffffff 64bit pref]
[ +0.000341] pci 0000:08:00.0: reg 0x18: [mem 0x00000000-0x1fffffffff 64bit
pref]
[ +0.000266] pci 0000:08:00.0: reg 0x20: [mem 0x00000000-0x01ffffff 64bit pref]
[ +0.000424] pci 0000:08:00.0: Max Payload Size set to 128 (was 256, max 256)
[ +0.000457] pci 0000:08:00.0: Enabling HDA controller
[ +0.003461] pci 0000:08:00.0: 252.048 Gb/s available PCIe bandwidth, limited
by 16.0 GT/s PCIe x16 link at 0000:00:01.7 (capable of 504.112 Gb/s with 32.0
GT/s PCIe x16 link)
[ +0.001435] pci 0000:08:00.0: BAR 2: no space for [mem size 0x2000000000
64bit pref]
[ +0.000003] pci 0000:08:00.0: BAR 2: failed to assign [mem size 0x2000000000
64bit pref]
[ +0.000002] pci 0000:08:00.0: BAR 4: assigned [mem
0x383800000000-0x383801ffffff 64bit pref]
[ +0.000263] pci 0000:08:00.0: BAR 0: assigned [mem
0x383802000000-0x383802ffffff 64bit pref]
With a sufficiently sized MMIO window via the OVMF knob, it looks like there is
enough space for at least one GPU at the root:
80000000000-8dfffffffff : PCI Bus 0000:00
but bus 0000:08 (which is what my hotplugged GPU gets assigned to) only has
32GB space, which isn't enough for the 128GB BAR:
383800000000-383fffffffff : PCI Bus 0000:08
I am not sure if there's a way to force bus 0000:08 to use more of the overall
MMIO window space after boot, but I assume there must be given that it is
appropriately sized in the working configs. (currently, the rest of it is taken
up by PCI slots not in use, and even if I remove those from my libvirt config,
slot 0000:08 stays the same size.) (or, what would be even better would be a
way to do exactly what pci=realloc does after I hotplug, since even the memory
topology for that config is quite different.)
> Not directly.
Thinking ahead here: hypothetically, if I were to propose a patch to add a knob
for this similar to X-PciMmio64Mb to MemDetect.c, do you think it could be
acceptable? It seems that the immediately viable workaround for our specific
use case would be to disable PlatformDynamicMMIOWindow via a qemu option, and
if this is an issue with many large BAR Nvidia GPUs, it could be broadly useful
until the root issue is fixed in the kernel. I already patched and tested a
knob for this in a local build, and it works (and shouldn't introduce any
regressions, since omission of the flag would just mean PDMW gets called as it
does today.)
(may not be necessary if I can figure out how to get the bus resized to work
with hotplug, though)
Thanks,
Mitchell Augustin
-=-=-=-=-=-=-=-=-=-=-=-
Groups.io Links: You receive all messages sent to this group.
View/Reply Online (#120838): https://edk2.groups.io/g/devel/message/120838
Mute This Topic: https://groups.io/mt/109651206/21656
Group Owner: devel+ow...@edk2.groups.io
Unsubscribe: https://edk2.groups.io/g/devel/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-
From guest VM that booted quickly, has 52 physbits/57 virtual bits, and in
which GPU driver does not work since `pci=realloc pci=nocrs isn't set:
ubuntu@testbox01:~$ sudo cat /proc/iomem
00000000-00000fff : Reserved
00001000-0009ffff : System RAM
000a0000-000bffff : PCI Bus 0000:00
000f0000-000fffff : System ROM
00100000-7e317017 : System RAM
7e317018-7e349057 : System RAM
7e349058-7ed3efff : System RAM
7ed3f000-7edfffff : Reserved
7ee00000-7f8ecfff : System RAM
7f8ed000-7fb6cfff : Reserved
7fb6d000-7fb7efff : ACPI Tables
7fb7f000-7fbfefff : ACPI Non-volatile Storage
7fbff000-7ff7bfff : System RAM
7ff7c000-7fffffff : Reserved
80000000-dfffffff : PCI Bus 0000:00
80000000-801fffff : PCI Bus 0000:0e
80200000-803fffff : PCI Bus 0000:0d
80400000-805fffff : PCI Bus 0000:0c
80600000-807fffff : PCI Bus 0000:0b
80600000-80600fff : 0000:0b:00.0
80800000-809fffff : PCI Bus 0000:0a
80a00000-80bfffff : PCI Bus 0000:09
80c00000-80dfffff : PCI Bus 0000:08
80e00000-80ffffff : PCI Bus 0000:07
81000000-811fffff : PCI Bus 0000:06
81200000-813fffff : PCI Bus 0000:05
81200000-81200fff : 0000:05:00.0
81400000-815fffff : PCI Bus 0000:04
81400000-81400fff : 0000:04:00.0
81600000-817fffff : PCI Bus 0000:03
81600000-81600fff : 0000:03:00.0
81800000-819fffff : PCI Bus 0000:02
81800000-81803fff : 0000:02:00.0
81800000-81803fff : xhci-hcd
81a00000-81bfffff : PCI Bus 0000:01
81a00000-81a00fff : 0000:01:00.0
81a80000-81afffff : 0000:01:00.0
81c80000-81c80fff : 0000:00:1f.2
81c80000-81c80fff : ahci
81c81000-81c81fff : 0000:00:02.5
81c82000-81c82fff : 0000:00:02.4
81c83000-81c83fff : 0000:00:02.3
81c84000-81c84fff : 0000:00:02.2
81c85000-81c85fff : 0000:00:02.1
81c86000-81c86fff : 0000:00:02.0
81c87000-81c87fff : 0000:00:01.7
81c88000-81c88fff : 0000:00:01.6
81c89000-81c89fff : 0000:00:01.5
81c8a000-81c8afff : 0000:00:01.4
81c8b000-81c8bfff : 0000:00:01.3
81c8c000-81c8cfff : 0000:00:01.2
81c8d000-81c8dfff : 0000:00:01.1
81c8e000-81c8efff : 0000:00:01.0
e0000000-efffffff : PCI MMCONFIG 0000 [bus 00-ff]
e0000000-efffffff : Reserved
e0000000-efffffff : pnp 00:04
f0000000-febfffff : PCI Bus 0000:00
fec00000-fec003ff : IOAPIC 0
fed40000-fed40fff : MSFT0101:00
fed40000-fed40fff : MSFT0101:00
fee00000-fee00fff : Local APIC
feffc000-feffffff : Reserved
ffc00000-ffffffff : Reserved
100000000-e6dfffffff : System RAM
1384c00000-1385c022c1 : Kernel code
1385e00000-13868b4fff : Kernel rodata
1386a00000-1386e4b4ff : Kernel data
13871bd000-13883fffff : Kernel bss
e800000000-efffffffff : PCI Bus 0000:00
e800000000-e8000fffff : PCI Bus 0000:01
e800000000-e800003fff : 0000:01:00.0
e800000000-e800003fff : virtio-pci-modern
e800100000-e8001fffff : PCI Bus 0000:03
e800100000-e800103fff : 0000:03:00.0
e800100000-e800103fff : virtio-pci-modern
e800200000-e8002fffff : PCI Bus 0000:04
e800200000-e800203fff : 0000:04:00.0
e800200000-e800203fff : virtio-pci-modern
e800300000-e8003fffff : PCI Bus 0000:05
e800300000-e800303fff : 0000:05:00.0
e800300000-e800303fff : virtio-pci-modern
e800400000-e8004fffff : PCI Bus 0000:0a
e800400000-e800403fff : 0000:0a:00.0
e800400000-e800403fff : virtio-pci-modern
e800500000-e8005fffff : PCI Bus 0000:0b
e800500000-e800503fff : 0000:0b:00.0
e800500000-e800503fff : virtio-pci-modern
e800600000-e8007fffff : PCI Bus 0000:0e
e800800000-e8009fffff : PCI Bus 0000:0d
e800a00000-e800bfffff : PCI Bus 0000:0c
e800c00000-e800dfffff : PCI Bus 0000:02
Same guest, but with `pci=realloc pci=nocrs`:
ubuntu@testbox01:~$ sudo cat /proc/iomem
00000000-00000fff : Reserved
00001000-0009ffff : System RAM
000f0000-000fffff : System ROM
00100000-7e319017 : System RAM
7e319018-7e34b057 : System RAM
7e34b058-7ed3efff : System RAM
7ed3f000-7edfffff : Reserved
7ee00000-7f8ecfff : System RAM
7f8ed000-7fb6cfff : Reserved
7fb6d000-7fb7efff : ACPI Tables
7fb7f000-7fbfefff : ACPI Non-volatile Storage
7fbff000-7ff7bfff : System RAM
7ff7c000-7fffffff : Reserved
80000000-801fffff : PCI Bus 0000:0e
80200000-803fffff : PCI Bus 0000:0d
80400000-805fffff : PCI Bus 0000:0c
80600000-807fffff : PCI Bus 0000:0b
80600000-80600fff : 0000:0b:00.0
80800000-809fffff : PCI Bus 0000:0a
80a00000-80bfffff : PCI Bus 0000:09
80c00000-80dfffff : PCI Bus 0000:08
80e00000-80ffffff : PCI Bus 0000:07
81000000-811fffff : PCI Bus 0000:06
81200000-813fffff : PCI Bus 0000:05
81200000-81200fff : 0000:05:00.0
81400000-815fffff : PCI Bus 0000:04
81400000-81400fff : 0000:04:00.0
81600000-817fffff : PCI Bus 0000:03
81600000-81600fff : 0000:03:00.0
81800000-819fffff : PCI Bus 0000:02
81800000-81803fff : 0000:02:00.0
81800000-81803fff : xhci-hcd
81a00000-81bfffff : PCI Bus 0000:01
81a00000-81a00fff : 0000:01:00.0
81a80000-81afffff : 0000:01:00.0
81c80000-81c80fff : 0000:00:1f.2
81c80000-81c80fff : ahci
81c81000-81c81fff : 0000:00:02.5
81c82000-81c82fff : 0000:00:02.4
81c83000-81c83fff : 0000:00:02.3
81c84000-81c84fff : 0000:00:02.2
81c85000-81c85fff : 0000:00:02.1
81c86000-81c86fff : 0000:00:02.0
81c87000-81c87fff : 0000:00:01.7
81c88000-81c88fff : 0000:00:01.6
81c89000-81c89fff : 0000:00:01.5
81c8a000-81c8afff : 0000:00:01.4
81c8b000-81c8bfff : 0000:00:01.3
81c8c000-81c8cfff : 0000:00:01.2
81c8d000-81c8dfff : 0000:00:01.1
81c8e000-81c8efff : 0000:00:01.0
e0000000-efffffff : PCI MMCONFIG 0000 [bus 00-ff]
e0000000-efffffff : Reserved
e0000000-efffffff : pnp 00:04
fec00000-fec003ff : IOAPIC 0
fed40000-fed40fff : MSFT0101:00
fed40000-fed40fff : MSFT0101:00
fee00000-fee00fff : Local APIC
feffc000-feffffff : Reserved
ffc00000-ffffffff : Reserved
100000000-e6dfffffff : System RAM
1162e00000-1163e022c1 : Kernel code
1164000000-1164ab4fff : Kernel rodata
1164c00000-116504b4ff : Kernel data
11653bd000-11665fffff : Kernel bss
e6e0000000-e6e01fffff : PCI Bus 0000:02
e6e0200000-e6e03fffff : PCI Bus 0000:0c
e6e0400000-e6e05fffff : PCI Bus 0000:0d
e6e0600000-e6e07fffff : PCI Bus 0000:0e
e800000000-e8000fffff : PCI Bus 0000:01
e800000000-e800003fff : 0000:01:00.0
e800000000-e800003fff : virtio-pci-modern
e800100000-e8001fffff : PCI Bus 0000:03
e800100000-e800103fff : 0000:03:00.0
e800100000-e800103fff : virtio-pci-modern
e800200000-e8002fffff : PCI Bus 0000:04
e800200000-e800203fff : 0000:04:00.0
e800200000-e800203fff : virtio-pci-modern
e800300000-e8003fffff : PCI Bus 0000:05
e800300000-e800303fff : 0000:05:00.0
e800300000-e800303fff : virtio-pci-modern
e800400000-e8004fffff : PCI Bus 0000:0a
e800400000-e800403fff : 0000:0a:00.0
e800400000-e800403fff : virtio-pci-modern
e800500000-e8005fffff : PCI Bus 0000:0b
e800500000-e800503fff : 0000:0b:00.0
e800500000-e800503fff : virtio-pci-modern
f000000000-11fffffffff : PCI Bus 0000:06
f000000000-f001ffffff : 0000:06:00.0
f002000000-f002ffffff : 0000:06:00.0
10000000000-11fffffffff : 0000:06:00.0
12000000000-14fffffffff : PCI Bus 0000:07
12000000000-13fffffffff : 0000:07:00.0
14000000000-14001ffffff : 0000:07:00.0
14002000000-14002ffffff : 0000:07:00.0
15000000000-17fffffffff : PCI Bus 0000:08
15000000000-15001ffffff : 0000:08:00.0
15002000000-15002ffffff : 0000:08:00.0
16000000000-17fffffffff : 0000:08:00.0
18000000000-1afffffffff : PCI Bus 0000:09
18000000000-19fffffffff : 0000:09:00.0
1a000000000-1a001ffffff : 0000:09:00.0
1a002000000-1a002ffffff : 0000:09:00.0
From guest VM that booted slowly, has 52 physbits/57 virtual bits, and in which
GPU driver works correctly:
ubuntu@testbox01:~$ sudo cat /proc/iomem
00000000-00000fff : Reserved
00001000-0009ffff : System RAM
000a0000-000bffff : PCI Bus 0000:00
000f0000-000fffff : System ROM
00100000-7e326017 : System RAM
7e326018-7e358057 : System RAM
7e358058-7ed3efff : System RAM
7ed3f000-7edfffff : Reserved
7ee00000-7f8ecfff : System RAM
7f8ed000-7fb6cfff : Reserved
7fb6d000-7fb7efff : ACPI Tables
7fb7f000-7fbfefff : ACPI Non-volatile Storage
7fbff000-7ff7bfff : System RAM
7ff7c000-7fffffff : Reserved
80000000-dfffffff : PCI Bus 0000:00
80000000-801fffff : PCI Bus 0000:0e
80200000-803fffff : PCI Bus 0000:0d
80400000-805fffff : PCI Bus 0000:0c
80600000-807fffff : PCI Bus 0000:0b
80600000-80600fff : 0000:0b:00.0
80800000-809fffff : PCI Bus 0000:0a
80a00000-80bfffff : PCI Bus 0000:09
80c00000-80dfffff : PCI Bus 0000:08
80e00000-80ffffff : PCI Bus 0000:07
81000000-811fffff : PCI Bus 0000:06
81200000-813fffff : PCI Bus 0000:05
81200000-81200fff : 0000:05:00.0
81400000-815fffff : PCI Bus 0000:04
81400000-81400fff : 0000:04:00.0
81600000-817fffff : PCI Bus 0000:03
81600000-81600fff : 0000:03:00.0
81800000-819fffff : PCI Bus 0000:02
81800000-81803fff : 0000:02:00.0
81800000-81803fff : xhci-hcd
81a00000-81bfffff : PCI Bus 0000:01
81a00000-81a00fff : 0000:01:00.0
81a80000-81afffff : 0000:01:00.0
81c80000-81c80fff : 0000:00:1f.2
81c80000-81c80fff : ahci
81c81000-81c81fff : 0000:00:02.5
81c82000-81c82fff : 0000:00:02.4
81c83000-81c83fff : 0000:00:02.3
81c84000-81c84fff : 0000:00:02.2
81c85000-81c85fff : 0000:00:02.1
81c86000-81c86fff : 0000:00:02.0
81c87000-81c87fff : 0000:00:01.7
81c88000-81c88fff : 0000:00:01.6
81c89000-81c89fff : 0000:00:01.5
81c8a000-81c8afff : 0000:00:01.4
81c8b000-81c8bfff : 0000:00:01.3
81c8c000-81c8cfff : 0000:00:01.2
81c8d000-81c8dfff : 0000:00:01.1
81c8e000-81c8efff : 0000:00:01.0
e0000000-efffffff : PCI MMCONFIG 0000 [bus 00-ff]
e0000000-efffffff : Reserved
e0000000-efffffff : pnp 00:04
f0000000-febfffff : PCI Bus 0000:00
fec00000-fec003ff : IOAPIC 0
fed40000-fed40fff : MSFT0101:00
fed40000-fed40fff : MSFT0101:00
fee00000-fee00fff : Local APIC
feffc000-feffffff : Reserved
ffc00000-ffffffff : Reserved
100000000-e6dfffffff : System RAM
239ce00000-239de022c1 : Kernel code
239e000000-239eab4fff : Kernel rodata
239ec00000-239f04b4ff : Kernel data
239f3bd000-23a05fffff : Kernel bss
380000000000-3937ffffffff : PCI Bus 0000:00
380000000000-382002ffffff : PCI Bus 0000:06
380000000000-381fffffffff : 0000:06:00.0
382000000000-382001ffffff : 0000:06:00.0
382002000000-382002ffffff : 0000:06:00.0
384000000000-386002ffffff : PCI Bus 0000:07
384000000000-385fffffffff : 0000:07:00.0
386000000000-386001ffffff : 0000:07:00.0
386002000000-386002ffffff : 0000:07:00.0
388000000000-38a002ffffff : PCI Bus 0000:08
388000000000-389fffffffff : 0000:08:00.0
38a000000000-38a001ffffff : 0000:08:00.0
38a002000000-38a002ffffff : 0000:08:00.0
38c000000000-38e002ffffff : PCI Bus 0000:09
38c000000000-38dfffffffff : 0000:09:00.0
38e000000000-38e001ffffff : 0000:09:00.0
38e002000000-38e002ffffff : 0000:09:00.0
38e800000000-38efffffffff : PCI Bus 0000:01
38e800000000-38e800003fff : 0000:01:00.0
38e800000000-38e800003fff : virtio-pci-modern
38f000000000-38f7ffffffff : PCI Bus 0000:02
38f800000000-38ffffffffff : PCI Bus 0000:03
38f800000000-38f800003fff : 0000:03:00.0
38f800000000-38f800003fff : virtio-pci-modern
390000000000-3907ffffffff : PCI Bus 0000:04
390000000000-390000003fff : 0000:04:00.0
390000000000-390000003fff : virtio-pci-modern
390800000000-390fffffffff : PCI Bus 0000:05
390800000000-390800003fff : 0000:05:00.0
390800000000-390800003fff : virtio-pci-modern
391000000000-3917ffffffff : PCI Bus 0000:0a
391000000000-391000003fff : 0000:0a:00.0
391000000000-391000003fff : virtio-pci-modern
391800000000-391fffffffff : PCI Bus 0000:0b
391800000000-391800003fff : 0000:0b:00.0
391800000000-391800003fff : virtio-pci-modern
392000000000-3927ffffffff : PCI Bus 0000:0c
392800000000-392fffffffff : PCI Bus 0000:0d
393000000000-3937ffffffff : PCI Bus 0000:0e
00000000-00000fff : Reserved
00001000-0009ffff : System RAM
000a0000-000fffff : Reserved
000a0000-000bffff : PCI Bus 0000:00
000c8000-000cffff : PCI Bus 0000:00
000f0000-000fffff : System ROM
00100000-595d8017 : System RAM
595d8018-59697257 : System RAM
59697258-59698017 : System RAM
59698018-59757257 : System RAM
59757258-59758017 : System RAM
59758018-59817257 : System RAM
59817258-60200017 : System RAM
60200018-602bf257 : System RAM
602bf258-60b52017 : System RAM
60b52018-60ba5657 : System RAM
60ba5658-60ba6017 : System RAM
60ba6018-60bdee57 : System RAM
60bdee58-60bdf017 : System RAM
60bdf018-60be5457 : System RAM
60be5458-60be8017 : System RAM
60be8018-60bee457 : System RAM
60bee458-60e2ffff : System RAM
60e30000-60e30fff : Reserved
60e31000-65d92fff : System RAM
65d93000-65d95fff : Reserved
65d96000-6f702fff : System RAM
6f703000-71802fff : Reserved
717b1018-717b1018 : APEI ERST
717b101c-717b1021 : APEI ERST
717b1028-717b1039 : APEI ERST
717b1040-717b104c : APEI ERST
717b1050-717b304f : APEI ERST
71803000-72102fff : ACPI Tables
72103000-7530efff : ACPI Non-volatile Storage
7530f000-777fefff : Reserved
777ff000-777fffff : System RAM
77800000-7fffffff : Reserved
80000000-8fffffff : PCI ECAM 0000 [bus 00-ff]
90040000-aaffffff : PCI Bus 0000:00
9e000000-9fffffff : 0000:00:1f.5
a0000000-a7ffffff : PCI Bus 0000:05
a0000000-a7ffffff : PCI Bus 0000:06
a0000000-a1ffffff : PCI Bus 0000:0a
a0000000-a1ffffff : 0000:0a:00.0
a2000000-a3ffffff : PCI Bus 0000:09
a2000000-a3ffffff : 0000:09:00.0
a4000000-a5ffffff : PCI Bus 0000:08
a4000000-a5ffffff : 0000:08:00.0
a6000000-a7ffffff : PCI Bus 0000:07
a6000000-a7ffffff : 0000:07:00.0
a8000000-a90fffff : PCI Bus 0000:03
a8000000-a90fffff : PCI Bus 0000:04
a8000000-a8ffffff : 0000:04:00.0
a9000000-a903ffff : 0000:04:00.0
a9000000-a903ffff : ast
a9100000-a93fffff : PCI Bus 0000:0b
a9100000-a917ffff : 0000:0b:00.0
a9180000-a927ffff : 0000:0b:00.0
a9280000-a937ffff : 0000:0b:00.0
a9400000-a94fffff : PCI Bus 0000:02
a9400000-a940ffff : 0000:02:00.0
a9410000-a9413fff : 0000:02:00.0
a9410000-a9413fff : nvme
a9500000-a95fffff : PCI Bus 0000:01
a9500000-a950ffff : 0000:01:00.0
a9510000-a9513fff : 0000:01:00.0
a9510000-a9513fff : nvme
aaffc000-aaffcfff : dmar19
ab000000-afffffff : PCI Bus 0000:15
af600000-afefffff : PCI Bus 0000:16
af600000-afefffff : PCI Bus 0000:17
af600000-afdfffff : PCI Bus 0000:19
af600000-afdfffff : PCI Bus 0000:1a
af600000-afdfffff : PCI Bus 0000:1b
af600000-afdfffff : 0000:1b:00.0
afe00000-afefffff : PCI Bus 0000:18
afe00000-afefffff : 0000:18:00.0
afffc000-afffcfff : dmar10
b0000000-bfffffff : PCI Bus 0000:24
be000000-bf5fffff : PCI Bus 0000:25
be000000-beffffff : 0000:25:00.0
bf000000-bf5fffff : PCI Bus 0000:26
bf000000-bf5fffff : PCI Bus 0000:27
bf000000-bf5fffff : PCI Bus 0000:28
bf000000-bf1fffff : PCI Bus 0000:29
bf000000-bf0fffff : 0000:29:00.1
bf100000-bf1fffff : 0000:29:00.0
bf200000-bf2fffff : PCI Bus 0000:2d
bf200000-bf20ffff : 0000:2d:00.0
bf210000-bf217fff : 0000:2d:00.0
bf210000-bf217fff : nvme
bf300000-bf3fffff : PCI Bus 0000:2c
bf300000-bf30ffff : 0000:2c:00.0
bf310000-bf317fff : 0000:2c:00.0
bf310000-bf317fff : nvme
bf400000-bf4fffff : PCI Bus 0000:2b
bf400000-bf40ffff : 0000:2b:00.0
bf410000-bf417fff : 0000:2b:00.0
bf410000-bf417fff : nvme
bf500000-bf5fffff : PCI Bus 0000:2a
bf500000-bf50ffff : 0000:2a:00.0
bf510000-bf517fff : 0000:2a:00.0
bf510000-bf517fff : nvme
bfffc000-bfffcfff : dmar11
c0000000-c4ffffff : PCI Bus 0000:3d
c4600000-c4efffff : PCI Bus 0000:3e
c4600000-c4efffff : PCI Bus 0000:3f
c4600000-c4dfffff : PCI Bus 0000:41
c4600000-c4dfffff : PCI Bus 0000:42
c4600000-c4dfffff : PCI Bus 0000:43
c4600000-c4dfffff : 0000:43:00.0
c4e00000-c4efffff : PCI Bus 0000:40
c4e00000-c4efffff : 0000:40:00.0
c4ffc000-c4ffcfff : dmar12
c5000000-c9ffffff : PCI Bus 0000:4c
c9600000-c9efffff : PCI Bus 0000:4d
c9600000-c9efffff : PCI Bus 0000:4e
c9600000-c9dfffff : PCI Bus 0000:50
c9600000-c9dfffff : PCI Bus 0000:51
c9600000-c9dfffff : PCI Bus 0000:52
c9600000-c9dfffff : 0000:52:00.0
c9e00000-c9efffff : PCI Bus 0000:4f
c9e00000-c9efffff : 0000:4f:00.0
c9ffc000-c9ffcfff : dmar13
ca000000-ceffffff : PCI Bus 0000:5b
ce600000-ceefffff : PCI Bus 0000:5c
ce600000-ceefffff : PCI Bus 0000:5d
ce600000-cedfffff : PCI Bus 0000:5f
ce600000-cedfffff : PCI Bus 0000:60
ce600000-cedfffff : PCI Bus 0000:61
ce600000-cedfffff : 0000:61:00.0
cee00000-ceefffff : PCI Bus 0000:5e
cee00000-ceefffff : 0000:5e:00.0
ceffc000-ceffcfff : dmar14
cf000000-cf7fffff : PCI Bus 0000:6a
cf600000-cf6fffff : 0000:6a:03.0
cf700000-cf73ffff : 0000:6a:03.1
cf701000-cf70100f : intel_vsec.sdsi.0
cf701010-cf70101f : intel_vsec.telemetry.0
cf701020-cf70102f : intel_vsec.telemetry.0
cf701030-cf70103f : intel_vsec.telemetry.0
cf702000-cf70244f : intel_vsec.sdsi.0
cf703000-cf70501f : telem1
cf706000-cf70948f : telem2
cf70a000-cf70b80f : telem3
cf740000-cf741fff : 0000:6a:03.1
cf7fc000-cf7fcfff : dmar15
cf800000-cfffffff : PCI Bus 0000:6f
cfffc000-cfffcfff : dmar16
d0000000-d07fffff : PCI Bus 0000:74
d07fc000-d07fcfff : dmar17
d0800000-d0ffffff : PCI Bus 0000:79
d0ffc000-d0ffcfff : dmar18
d1200000-d120011f : 0000:7e:00.1
d1800000-d57fffff : PCI Bus 0000:80
d5600000-d56fffff : PCI Bus 0000:82
d5600000-d56fffff : 0000:82:00.0
d57fc000-d57fcfff : dmar5
d5800000-da7fffff : PCI Bus 0000:97
d9e00000-da6fffff : PCI Bus 0000:98
d9e00000-da6fffff : PCI Bus 0000:99
d9e00000-da5fffff : PCI Bus 0000:9b
d9e00000-da5fffff : PCI Bus 0000:9c
d9e00000-da5fffff : PCI Bus 0000:9d
d9e00000-da5fffff : 0000:9d:00.0
da600000-da6fffff : PCI Bus 0000:9a
da600000-da6fffff : 0000:9a:00.0
da7fc000-da7fcfff : dmar0
da800000-ea7fffff : PCI Bus 0000:a5
e9000000-ea5fffff : PCI Bus 0000:a6
e9000000-e9ffffff : 0000:a6:00.0
ea000000-ea5fffff : PCI Bus 0000:a7
ea000000-ea5fffff : PCI Bus 0000:a8
ea000000-ea5fffff : PCI Bus 0000:a9
ea000000-ea1fffff : PCI Bus 0000:aa
ea000000-ea0fffff : 0000:aa:00.1
ea100000-ea1fffff : 0000:aa:00.0
ea200000-ea2fffff : PCI Bus 0000:ae
ea200000-ea20ffff : 0000:ae:00.0
ea210000-ea217fff : 0000:ae:00.0
ea210000-ea217fff : nvme
ea300000-ea3fffff : PCI Bus 0000:ad
ea300000-ea30ffff : 0000:ad:00.0
ea310000-ea317fff : 0000:ad:00.0
ea310000-ea317fff : nvme
ea400000-ea4fffff : PCI Bus 0000:ac
ea400000-ea40ffff : 0000:ac:00.0
ea410000-ea417fff : 0000:ac:00.0
ea410000-ea417fff : nvme
ea500000-ea5fffff : PCI Bus 0000:ab
ea500000-ea50ffff : 0000:ab:00.0
ea510000-ea517fff : 0000:ab:00.0
ea510000-ea517fff : nvme
ea7fc000-ea7fcfff : dmar1
ea800000-ef7fffff : PCI Bus 0000:bd
eee00000-ef6fffff : PCI Bus 0000:be
eee00000-ef6fffff : PCI Bus 0000:bf
eee00000-ef5fffff : PCI Bus 0000:c1
eee00000-ef5fffff : PCI Bus 0000:c2
eee00000-ef5fffff : PCI Bus 0000:c3
eee00000-ef5fffff : 0000:c3:00.0
ef600000-ef6fffff : PCI Bus 0000:c0
ef600000-ef6fffff : 0000:c0:00.0
ef7fc000-ef7fcfff : dmar2
ef800000-f47fffff : PCI Bus 0000:cb
f3e00000-f46fffff : PCI Bus 0000:cc
f3e00000-f46fffff : PCI Bus 0000:cd
f3e00000-f45fffff : PCI Bus 0000:cf
f3e00000-f45fffff : PCI Bus 0000:d0
f3e00000-f45fffff : PCI Bus 0000:d1
f3e00000-f45fffff : 0000:d1:00.0
f4600000-f46fffff : PCI Bus 0000:ce
f4600000-f46fffff : 0000:ce:00.0
f47fc000-f47fcfff : dmar3
f4800000-f97fffff : PCI Bus 0000:d9
f8e00000-f96fffff : PCI Bus 0000:da
f8e00000-f96fffff : PCI Bus 0000:db
f8e00000-f95fffff : PCI Bus 0000:dd
f8e00000-f95fffff : PCI Bus 0000:de
f8e00000-f95fffff : PCI Bus 0000:df
f8e00000-f95fffff : 0000:df:00.0
f9600000-f96fffff : PCI Bus 0000:dc
f9600000-f96fffff : 0000:dc:00.0
f97fc000-f97fcfff : dmar4
f9800000-f9ffffff : PCI Bus 0000:e7
f9e00000-f9efffff : 0000:e7:03.0
f9f00000-f9f3ffff : 0000:e7:03.1
f9f01000-f9f0100f : intel_vsec.sdsi.1
f9f01010-f9f0101f : intel_vsec.telemetry.1
f9f01020-f9f0102f : intel_vsec.telemetry.1
f9f01030-f9f0103f : intel_vsec.telemetry.1
f9f02000-f9f0244f : intel_vsec.sdsi.1
f9f03000-f9f0501f : telem4
f9f06000-f9f0948f : telem5
f9f0a000-f9f0b80f : telem6
f9f40000-f9f41fff : 0000:e7:03.1
f9ffc000-f9ffcfff : dmar6
fa000000-fa7fffff : PCI Bus 0000:ec
fa7fc000-fa7fcfff : dmar7
fa800000-faffffff : PCI Bus 0000:f1
faffc000-faffcfff : dmar8
fb000000-fb7fffff : PCI Bus 0000:f6
fb7fc000-fb7fcfff : dmar9
fba00000-fba0011f : 0000:fe:00.1
fd690000-fd69ffff : INTC1071:00
fd690000-fd69ffff : INTC1071:00 INTC1071:00
fd6a0000-fd6affff : INTC1071:00
fd6a0000-fd6affff : INTC1071:00 INTC1071:00
fd6b0000-fd6bffff : INTC1071:00
fd6b0000-fd6bffff : INTC1071:00 INTC1071:00
fd6c0000-fd6cffff : pnp 00:04
fd6d0000-fd6dffff : INTC1071:00
fd6d0000-fd6dffff : INTC1071:00 INTC1071:00
fd6e0000-fd6effff : INTC1071:00
fd6e0000-fd6effff : INTC1071:00 INTC1071:00
fd6f0000-fdffffff : pnp 00:04
fe010000-fe010fff : Reserved
fe010000-fe010fff : PCI Bus 0000:00
fe010000-fe010fff : 0000:00:1f.5
fe010000-fe010fff : 0000:00:1f.5 0000:00:1f.5
fe200000-fe7fffff : pnp 00:04
fec00000-fecfffff : PNP0003:00
fec00000-fec003ff : IOAPIC 0
fed00000-fed003ff : HPET 0
fed00000-fed003ff : PNP0103:00
ff000000-ffffffff : pnp 00:01
ff000000-ffffffff : pnp 00:04
100000000-2007fffffff : System RAM
1c341200000-1c3427fffff : Kernel code
1c342800000-1c3435f4fff : Kernel rodata
1c343600000-1c343a7a5ff : Kernel data
1c343f9d000-1c3443fffff : Kernel bss
200000000000-20ffffffffff : PCI Bus 0000:00
200000000000-2000001fffff : PCI Bus 0000:01
200000200000-2000003fffff : PCI Bus 0000:02
200000400000-2000004000ff : 0000:00:1f.4
20fffe400000-20fffe8fffff : PCI Bus 0000:0b
20fffe400000-20fffe7fffff : 0000:0b:00.0
20fffe400000-20fffe7fffff : ixgbe
20fffe800000-20fffe803fff : 0000:0b:00.0
20fffe800000-20fffe803fff : ixgbe
20fffec00000-20fffeffffff : PCI Bus 0000:05
20fffec00000-20fffeffffff : 0000:05:00.1
20fffec00000-20fffeffffff : switchtec
20ffff000000-20ffff7fffff : 0000:00:1f.7
20ffff000000-20ffff7fffff : intel_th_pci
20ffff800000-20ffff8fffff : 0000:00:1f.7
20ffff800000-20ffff8fffff : intel_th_pci
20ffff900000-20ffff91ffff : 0000:00:10.0
20ffff920000-20ffff93ffff : 0000:00:0d.0
20ffff940000-20ffff95ffff : 0000:00:0c.0
20ffff960000-20ffff97ffff : 0000:00:0a.0
20ffff980000-20ffff99ffff : 0000:00:08.0
20ffff9a0000-20ffff9affff : 0000:00:14.0
20ffff9a0000-20ffff9affff : xhci-hcd
20ffff9b0000-20ffff9b3fff : 0000:00:14.2
20ffff9b4000-20ffff9b4fff : 0000:00:16.0
20ffff9b5000-20ffff9b53ff : 0000:00:15.0
20ffff9b5000-20ffff9b53ff : ismt_smbus
20ffff9b6000-20ffff9b6fff : 0000:00:14.2
210000000000-21ffffffffff : PCI Bus 0000:15
21a000000000-21e047ffffff : PCI Bus 0000:16
21a000000000-21e047ffffff : PCI Bus 0000:17
21a000000000-21e042ffffff : PCI Bus 0000:19
21a000000000-21e042ffffff : PCI Bus 0000:1a
21a000000000-21e042ffffff : PCI Bus 0000:1b
21a000000000-21bfffffffff : 0000:1b:00.0
21c000000000-21dfffffffff : 0000:1b:00.0
21e000000000-21e03fffffff : 0000:1b:00.0
21e040000000-21e041ffffff : 0000:1b:00.0
21e042000000-21e042ffffff : 0000:1b:00.0
21e044000000-21e047ffffff : PCI Bus 0000:18
21e044000000-21e045ffffff : 0000:18:00.0
21e044000000-21e045ffffff : mlx5_core
21e046000000-21e047ffffff : 0000:18:00.0
21fffff00000-21fffff1ffff : 0000:15:01.0
220000000000-22ffffffffff : PCI Bus 0000:24
22fff6000000-22fffdffffff : PCI Bus 0000:25
22fff6000000-22fffdffffff : PCI Bus 0000:26
22fff6000000-22fffdffffff : PCI Bus 0000:27
22fff6000000-22fffdffffff : PCI Bus 0000:28
22fff6000000-22fffdffffff : PCI Bus 0000:29
22fff6000000-22fff7ffffff : 0000:29:00.1
22fff6000000-22fff7ffffff : mlx5_core
22fff8000000-22fff9ffffff : 0000:29:00.0
22fff8000000-22fff9ffffff : mlx5_core
22fffa000000-22fffbffffff : 0000:29:00.1
22fffc000000-22fffdffffff : 0000:29:00.0
22fffff00000-22fffff1ffff : 0000:24:01.0
230000000000-23ffffffffff : PCI Bus 0000:3d
23a000000000-23e047ffffff : PCI Bus 0000:3e
23a000000000-23e047ffffff : PCI Bus 0000:3f
23a000000000-23e042ffffff : PCI Bus 0000:41
23a000000000-23e042ffffff : PCI Bus 0000:42
23a000000000-23e042ffffff : PCI Bus 0000:43
23a000000000-23bfffffffff : 0000:43:00.0
23c000000000-23dfffffffff : 0000:43:00.0
23e000000000-23e03fffffff : 0000:43:00.0
23e040000000-23e041ffffff : 0000:43:00.0
23e042000000-23e042ffffff : 0000:43:00.0
23e044000000-23e047ffffff : PCI Bus 0000:40
23e044000000-23e045ffffff : 0000:40:00.0
23e044000000-23e045ffffff : mlx5_core
23e046000000-23e047ffffff : 0000:40:00.0
23fffff00000-23fffff1ffff : 0000:3d:01.0
240000000000-24ffffffffff : PCI Bus 0000:4c
24a000000000-24e047ffffff : PCI Bus 0000:4d
24a000000000-24e047ffffff : PCI Bus 0000:4e
24a000000000-24e042ffffff : PCI Bus 0000:50
24a000000000-24e042ffffff : PCI Bus 0000:51
24a000000000-24e042ffffff : PCI Bus 0000:52
24a000000000-24bfffffffff : 0000:52:00.0
24c000000000-24dfffffffff : 0000:52:00.0
24e000000000-24e03fffffff : 0000:52:00.0
24e040000000-24e041ffffff : 0000:52:00.0
24e042000000-24e042ffffff : 0000:52:00.0
24e044000000-24e047ffffff : PCI Bus 0000:4f
24e044000000-24e045ffffff : 0000:4f:00.0
24e044000000-24e045ffffff : mlx5_core
24e046000000-24e047ffffff : 0000:4f:00.0
24fffff00000-24fffff1ffff : 0000:4c:01.0
250000000000-25ffffffffff : PCI Bus 0000:5b
25a000000000-25e047ffffff : PCI Bus 0000:5c
25a000000000-25e047ffffff : PCI Bus 0000:5d
25a000000000-25e042ffffff : PCI Bus 0000:5f
25a000000000-25e042ffffff : PCI Bus 0000:60
25a000000000-25e042ffffff : PCI Bus 0000:61
25a000000000-25bfffffffff : 0000:61:00.0
25c000000000-25dfffffffff : 0000:61:00.0
25e000000000-25e03fffffff : 0000:61:00.0
25e040000000-25e041ffffff : 0000:61:00.0
25e042000000-25e042ffffff : 0000:61:00.0
25e044000000-25e047ffffff : PCI Bus 0000:5e
25e044000000-25e045ffffff : 0000:5e:00.0
25e044000000-25e045ffffff : mlx5_core
25e046000000-25e047ffffff : 0000:5e:00.0
25fffff00000-25fffff1ffff : 0000:5b:01.0
260000000000-2600ffffffff : PCI Bus 0000:6b
260000000000-2600007fffff : 0000:6b:00.0
260000000000-2600007fffff : 0000:6b:00.0
260000800000-2600009fffff : 0000:6b:00.0
260000800000-2600009fffff : 0000:6b:00.0
260000a00000-260000a7ffff : 0000:6b:00.0
260000a00000-260000a7ffff : 0000:6b:00.0
260000a80000-260000afffff : 0000:6b:00.0
260000e80000-260000efffff : 0000:6b:00.0
260001280000-26000129ffff : 0000:6b:00.0
260100000000-2604ffffffff : PCI Bus 0000:6d
260100000000-2601ffffffff : 0000:6d:00.0
260200000000-26023fffffff : 0000:6d:00.0
260240000000-260243ffffff : 0000:6d:00.0
260500000000-26ffffffffff : PCI Bus 0000:6a
26fffff00000-26fffff1ffff : 0000:6a:02.0
26fffff20000-26fffff3ffff : 0000:6a:01.0
26fffff40000-26fffff4ffff : 0000:6a:02.0
26fffff50000-26fffff5ffff : 0000:6a:01.0
270000000000-27ffffffffff : PCI Bus 0000:6f
280000000000-28ffffffffff : PCI Bus 0000:74
290000000000-29ffffffffff : PCI Bus 0000:79
2a0000000000-2affffffffff : PCI Bus 0000:80
2afffa000000-2afffe4fffff : PCI Bus 0000:82
2afffa000000-2afffbffffff : 0000:82:00.0
2afffa000000-2afffbffffff : ice
2afffc000000-2afffdffffff : 0000:82:00.0
2afffe000000-2afffe00ffff : 0000:82:00.0
2afffe010000-2afffe40ffff : 0000:82:00.0
2afffff00000-2afffff1ffff : 0000:80:05.0
2afffff20000-2afffff3ffff : 0000:80:01.0
2b0000000000-2bffffffffff : PCI Bus 0000:97
2ba000000000-2be047ffffff : PCI Bus 0000:98
2ba000000000-2be047ffffff : PCI Bus 0000:99
2ba000000000-2be042ffffff : PCI Bus 0000:9b
2ba000000000-2be042ffffff : PCI Bus 0000:9c
2ba000000000-2be042ffffff : PCI Bus 0000:9d
2ba000000000-2bbfffffffff : 0000:9d:00.0
2bc000000000-2bdfffffffff : 0000:9d:00.0
2be000000000-2be03fffffff : 0000:9d:00.0
2be040000000-2be041ffffff : 0000:9d:00.0
2be042000000-2be042ffffff : 0000:9d:00.0
2be044000000-2be047ffffff : PCI Bus 0000:9a
2be044000000-2be045ffffff : 0000:9a:00.0
2be044000000-2be045ffffff : mlx5_core
2be046000000-2be047ffffff : 0000:9a:00.0
2bfffff00000-2bfffff1ffff : 0000:97:01.0
2c0000000000-2cffffffffff : PCI Bus 0000:a5
2cfff6000000-2cfffdffffff : PCI Bus 0000:a6
2cfff6000000-2cfffdffffff : PCI Bus 0000:a7
2cfff6000000-2cfffdffffff : PCI Bus 0000:a8
2cfff6000000-2cfffdffffff : PCI Bus 0000:a9
2cfff6000000-2cfffdffffff : PCI Bus 0000:aa
2cfff6000000-2cfff7ffffff : 0000:aa:00.1
2cfff6000000-2cfff7ffffff : mlx5_core
2cfff8000000-2cfff9ffffff : 0000:aa:00.0
2cfff8000000-2cfff9ffffff : mlx5_core
2cfffa000000-2cfffbffffff : 0000:aa:00.1
2cfffc000000-2cfffdffffff : 0000:aa:00.0
2cfffff00000-2cfffff1ffff : 0000:a5:01.0
2d0000000000-2dffffffffff : PCI Bus 0000:bd
2da000000000-2de047ffffff : PCI Bus 0000:be
2da000000000-2de047ffffff : PCI Bus 0000:bf
2da000000000-2de042ffffff : PCI Bus 0000:c1
2da000000000-2de042ffffff : PCI Bus 0000:c2
2da000000000-2de042ffffff : PCI Bus 0000:c3
2da000000000-2dbfffffffff : 0000:c3:00.0
2dc000000000-2ddfffffffff : 0000:c3:00.0
2de000000000-2de03fffffff : 0000:c3:00.0
2de040000000-2de041ffffff : 0000:c3:00.0
2de042000000-2de042ffffff : 0000:c3:00.0
2de044000000-2de047ffffff : PCI Bus 0000:c0
2de044000000-2de045ffffff : 0000:c0:00.0
2de044000000-2de045ffffff : mlx5_core
2de046000000-2de047ffffff : 0000:c0:00.0
2dfffff00000-2dfffff1ffff : 0000:bd:01.0
2e0000000000-2effffffffff : PCI Bus 0000:cb
2ea000000000-2ee047ffffff : PCI Bus 0000:cc
2ea000000000-2ee047ffffff : PCI Bus 0000:cd
2ea000000000-2ee042ffffff : PCI Bus 0000:cf
2ea000000000-2ee042ffffff : PCI Bus 0000:d0
2ea000000000-2ee042ffffff : PCI Bus 0000:d1
2ea000000000-2ebfffffffff : 0000:d1:00.0
2ec000000000-2edfffffffff : 0000:d1:00.0
2ee000000000-2ee03fffffff : 0000:d1:00.0
2ee040000000-2ee041ffffff : 0000:d1:00.0
2ee042000000-2ee042ffffff : 0000:d1:00.0
2ee044000000-2ee047ffffff : PCI Bus 0000:ce
2ee044000000-2ee045ffffff : 0000:ce:00.0
2ee044000000-2ee045ffffff : mlx5_core
2ee046000000-2ee047ffffff : 0000:ce:00.0
2efffff00000-2efffff1ffff : 0000:cb:01.0
2f0000000000-2fffffffffff : PCI Bus 0000:d9
2fa000000000-2fe047ffffff : PCI Bus 0000:da
2fa000000000-2fe047ffffff : PCI Bus 0000:db
2fa000000000-2fe042ffffff : PCI Bus 0000:dd
2fa000000000-2fe042ffffff : PCI Bus 0000:de
2fa000000000-2fe042ffffff : PCI Bus 0000:df
2fa000000000-2fbfffffffff : 0000:df:00.0
2fc000000000-2fdfffffffff : 0000:df:00.0
2fe000000000-2fe03fffffff : 0000:df:00.0
2fe040000000-2fe041ffffff : 0000:df:00.0
2fe042000000-2fe042ffffff : 0000:df:00.0
2fe044000000-2fe047ffffff : PCI Bus 0000:dc
2fe044000000-2fe045ffffff : 0000:dc:00.0
2fe044000000-2fe045ffffff : mlx5_core
2fe046000000-2fe047ffffff : 0000:dc:00.0
2ffffff00000-2ffffff1ffff : 0000:d9:01.0
300000000000-3000ffffffff : PCI Bus 0000:e8
300000000000-3000007fffff : 0000:e8:00.0
300000000000-3000007fffff : 0000:e8:00.0
300000800000-3000009fffff : 0000:e8:00.0
300000800000-3000009fffff : 0000:e8:00.0
300000a00000-300000a7ffff : 0000:e8:00.0
300000a00000-300000a7ffff : 0000:e8:00.0
300000a80000-300000afffff : 0000:e8:00.0
300000e80000-300000efffff : 0000:e8:00.0
300001280000-30000129ffff : 0000:e8:00.0
300100000000-3004ffffffff : PCI Bus 0000:ea
300100000000-3001ffffffff : 0000:ea:00.0
300200000000-30023fffffff : 0000:ea:00.0
300240000000-300243ffffff : 0000:ea:00.0
300500000000-30ffffffffff : PCI Bus 0000:e7
30fffff00000-30fffff1ffff : 0000:e7:02.0
30fffff20000-30fffff3ffff : 0000:e7:01.0
30fffff40000-30fffff4ffff : 0000:e7:02.0
30fffff50000-30fffff5ffff : 0000:e7:01.0
310000000000-31ffffffffff : PCI Bus 0000:ec
320000000000-32ffffffffff : PCI Bus 0000:f1
330000000000-33ffffffffff : PCI Bus 0000:f6
