On 2024/11/19 20:46, Roger Pau Monné wrote:
> On Mon, Nov 18, 2024 at 06:06:03AM +0000, Chen, Jiqian wrote:
>> On 2024/11/15 19:42, Roger Pau Monné wrote:
>>> On Fri, Nov 15, 2024 at 03:04:22AM +0000, Chen, Jiqian wrote:
>>>> On 2024/11/15 01:36, Roger Pau Monné wrote:
>>>>> On Thu, Nov 14, 2024 at 04:52:18PM +0100, Roger Pau Monné wrote:
>>>>>> On Thu, Nov 14, 2024 at 06:11:46AM +0000, Chen, Jiqian wrote:
>>>>>>> On 2024/11/13 18:30, Roger Pau Monné wrote:
>>>>>>>> On Wed, Nov 13, 2024 at 10:00:33AM +0000, Chen, Jiqian wrote:
>>>>>>>>> On 2024/11/13 17:30, Roger Pau Monné wrote:
>>>>>>>>>> On Wed, Nov 13, 2024 at 04:00:27PM +0800, Jiqian Chen wrote:
>>>>>>>>>>> Some devices, like discrete GPU of amd, support resizable bar 
>>>>>>>>>>> capability,
>>>>>>>>>>> but vpci of Xen doesn't support this feature, so they fail to 
>>>>>>>>>>> resize bars
>>>>>>>>>>> and then cause probing failure.
>>>>>>>>>>>
>>>>>>>>>>> According to PCIe spec, each bar that support resizing has two 
>>>>>>>>>>> registers,
>>>>>>>>>>> PCI_REBAR_CAP and PCI_REBAR_CTRL, so add these two registers and 
>>>>>>>>>>> their
>>>>>>>>>>> corresponding handler into vpci.
>>>>>>>>>>>
>>>>>>>>>>> PCI_REBAR_CAP is RO, only provide reading.
>>>>>>>>>>>
>>>>>>>>>>> PCI_REBAR_CTRL only has bar size is RW, so add write function to 
>>>>>>>>>>> support
>>>>>>>>>>> setting the new size.
>>>>>>>>>>
>>>>>>>>>> I think the logic to handle resizable BAR could be much simpler.  
>>>>>>>>>> Some
>>>>>>>>>> time ago I've made a patch to add support for it, but due to lack of
>>>>>>>>>> hardware on my side to test it I've never submitted it.
>>>>>>>>>>
>>>>>>>>>> My approach would be to detect the presence of the
>>>>>>>>>> PCI_EXT_CAP_ID_REBAR capability in init_header(), and if the
>>>>>>>>>> capability is present force the sizing of BARs each time they are
>>>>>>>>>> mapped in modify_bars().  I don't think we need to trap accesses to
>>>>>>>>>> the capability itself, as resizing can only happen when memory
>>>>>>>>>> decoding is not enabled for the device.  It's enough to fetch the 
>>>>>>>>>> size
>>>>>>>>>> of the BARs ahead of each enabling of memory decoding.
>>>>>>>>>>
>>>>>>>>>> Note that memory decoding implies mapping the BARs into the p2m, 
>>>>>>>>>> which
>>>>>>>>>> is already an expensive operation, the extra sizing is unlikely to
>>>>>>>>>> make much of a difference performance wise.
>>>>>>>>>>
>>>>>>>>>> I've found the following on my git tree and rebased on top of 
>>>>>>>>>> staging:
>>>>>>>>> OK.
>>>>>>>>> Do you need me to validate your patch in my environment?
>>>>>>>>
>>>>>>>> Yes please, I have no way to test it.  Let's see what others think
>>>>>>>> about the different approaches.
>>>>>>> There are some errors with your method.
>>>>>>> I attached the dmesg and xl dmesg logs.
>>>>>>> From the dmesg logs, it seems that 0000:03:00.0 has addresse overlap 
>>>>>>> with 0000:03:00.1
>>>>>>
>>>>>> Do you have the output of lspci with the BAR sizes/positions before
>>>>>> and after the resizing?
>>>>>>
>>>>>>>
>>>>>>> I think there is a place that needs to be modified regarding your 
>>>>>>> method,
>>>>>>> although this modification does not help with the above-mentioned 
>>>>>>> errors,
>>>>>>> it is that whether to support resizing is specific to which bar, rather 
>>>>>>> than just determining whether there is a Rebar capability.
>>>>>>
>>>>>> Do we really need such fine-grained information?  It should be
>>>>>> harmless (even if not strictly necessary) to size all BARs on the
>>>>>> device before enabling memory decoding, even if some of them do not
>>>>>> support resizing.
>>>>>>
>>>>>> I might have to provide a patch with additional messages to see what's
>>>>>> going on.
>>>>>
>>>>> One nit that I've noticed with the patch I gave you previously is that
>>>>> the check for a size change in modify_bars() should be done ahead of
>>>>> pci_check_bar(), otherwise the check is possibly using an outdated
>>>>> size.
>>>>>
>>>>> I've also added a debug message to notify when a BAR register is
>>>>> written and report the new address.  This is done unconditionally, but
>>>>> if you think it's too chatty you can limit to only printing for the
>>>>> device that has the ReBAR capability.
>>>> Errors are the same.
>>>> Attached the dmesg, xl dmesg, patch and lspci output.
>>>> I will also continue to debug your method on my side to try to get some 
>>>> findings.
>>>
>>> Hello,
>>>
>>> I've been looking at the output, and it all seems fine, except the
>>> 03:00.0 device that becomes broken at some point, note the lspci
>>> output lists [virtual] next to the resource sizes.  This means reading
>>> for the registers returned 0, so the position and sizes are provided
>>> from the internal OS information.
>>>
>>> I'm assuming the patch you sent to the list doesn't lead to such errors,
>> Yes, the method of my patch doesn't lead to any errors.
>> I attached the dmesg, xl dmesg and lspci logs of my method.
>>
>>> in which case I can only guess that fetching the size of the
>>> BARs in modify_bars() causes issues with the device.
>>>
>>> To confirm this, can you try the following patch on top of your original 
>>> change?  
>> I tried below patch with my original patch, it didn't cause any errors.
>> And the lspci showed without the "[virtual]".
>> So, unfortunately, it is not related to the fetching size of Bars in 
>> modify_bars().
> 
> I see, I'm at a loss as to what's wrong with my patch.  Do you have
> any additional patches on Xen when testing your or my approach?
No, just my patch or your patch, base on upstream codes(kernel branch is 
linux-next and xen branch is staging).

> 
> I sadly don't have any box with a PCI device that exposes the
> resizable BAR capability, so I'm not able to test or debug this.
> 
> I would like to understand why my approach doesn't work, as otherwise
> I feel like I'm missing how ReBAR is supposed to work.  Anyway, if you
> can give a try to the diff below, it's the same patch, but with yet
> even more debug messages added.
Attached the xl dmesg.

> 
> Thanks, and sorry for keeping you testing it.
That's fine, feel free to send me if you need more test information.
Actually I am still continuing to debug your patch and also curious about why 
your patch does not work.

The only difference between our methods is the timing of updating the size.
Yours is later than mine because you updated the size when the driver 
re-enabled memory decoding, while I updated the size in time when driver resize 
it.
I suspect that the driver or hypervisor may have done something in between and 
read outdated information.
I am debugging the driver codes.

> 
> Regards, Roger.
> 
> diff --git a/xen/drivers/vpci/header.c b/xen/drivers/vpci/header.c
> index ef6c965c081c..dda42ef0b7ff 100644
> --- a/xen/drivers/vpci/header.c
> +++ b/xen/drivers/vpci/header.c
> @@ -316,6 +316,9 @@ static int modify_bars(const struct pci_dev *pdev, 
> uint16_t cmd, bool rom_only)
>  
>      ASSERT(rw_is_write_locked(&pdev->domain->pci_lock));
>  
> +    printk("%pp: modify bars cmd: %x rom_only: %d\n",
> +           &pdev->sbdf, cmd, rom_only);
> +
>      /*
>       * Create a rangeset per BAR that represents the current device memory
>       * region and compare it against all the currently active BAR memory
> @@ -346,6 +349,33 @@ static int modify_bars(const struct pci_dev *pdev, 
> uint16_t cmd, bool rom_only)
>               bar->enabled == !!(cmd & PCI_COMMAND_MEMORY) )
>              continue;
>  
> +        if ( bar->type != VPCI_BAR_ROM && header->bars_resizable &&
> +             (cmd & PCI_COMMAND_MEMORY) )
> +        {
> +            uint64_t addr, size;
> +
> +            pci_size_mem_bar(pdev->sbdf, PCI_BASE_ADDRESS_0 + i * 4,
> +                             &addr, &size, 0);
> +
> +            printk("%pp: BAR%u ReBAR supported addr %#lx -> %#lx size %#lx 
> -> %#lx\n",
> +                    &pdev->sbdf, i, bar->addr, addr, bar->size, size);
> +
> +            if ( bar->addr != addr )
> +                printk(XENLOG_G_ERR
> +                       "%pp: BAR#%u address mismatch %#lx vs %#lx\n",
> +                       &pdev->sbdf, i, bar->addr, addr);
> +
> +            if ( bar->size != size )
> +            {
> +                printk(XENLOG_G_DEBUG
> +                       "%pp: detected BAR#%u size change (%#lx -> %#lx)\n",
> +                       &pdev->sbdf, i, bar->size, size);
> +                bar->size = size;
> +                end = PFN_DOWN(bar->addr + size - 1);
> +                end_guest = PFN_DOWN(bar->guest_addr + size - 1);
> +            }
> +        }
> +
>          if ( !pci_check_bar(pdev, _mfn(start), _mfn(end)) )
>          {
>              printk(XENLOG_G_WARNING
> @@ -583,8 +613,6 @@ static void cf_check bar_write(
>       */
>      if ( bar->enabled )
>      {
> -        /* If the value written is the current one avoid printing a warning. 
> */
> -        if ( val != (uint32_t)(bar->addr >> (hi ? 32 : 0)) )
>              gprintk(XENLOG_WARNING,
>                      "%pp: ignored BAR %zu write while mapped\n",
>                      &pdev->sbdf, bar - pdev->vpci->header.bars + hi);
> @@ -601,6 +629,10 @@ static void cf_check bar_write(
>      /* Update guest address, so hardware domain BAR is identity mapped. */
>      bar->guest_addr = bar->addr;
>  
> +    printk("%pp: write BAR%zu val: %#x BAR%zu address: %#lx\n",
> +           &pdev->sbdf, bar - pdev->vpci->header.bars, val,
> +           bar - pdev->vpci->header.bars + hi, bar->addr);
> +
>      /* Make sure Xen writes back the same value for the BAR RO bits. */
>      if ( !hi )
>      {
> @@ -870,6 +902,9 @@ static int cf_check init_header(struct pci_dev *pdev)
>      if ( pdev->ignore_bars )
>          return 0;
>  
> +    header->bars_resizable = pci_find_ext_capability(pdev->sbdf,
> +                                                     PCI_EXT_CAP_ID_REBAR);
> +
>      cmd = pci_conf_read16(pdev->sbdf, PCI_COMMAND);
>  
>      /*
> diff --git a/xen/include/xen/pci_regs.h b/xen/include/xen/pci_regs.h
> index 250ba106dbd3..c543a2b86778 100644
> --- a/xen/include/xen/pci_regs.h
> +++ b/xen/include/xen/pci_regs.h
> @@ -459,6 +459,7 @@
>  #define PCI_EXT_CAP_ID_ARI   14
>  #define PCI_EXT_CAP_ID_ATS   15
>  #define PCI_EXT_CAP_ID_SRIOV 16
> +#define PCI_EXT_CAP_ID_REBAR 21
>  
>  /* Advanced Error Reporting */
>  #define PCI_ERR_UNCOR_STATUS 4       /* Uncorrectable Error Status */
> diff --git a/xen/include/xen/vpci.h b/xen/include/xen/vpci.h
> index 41e7c3bc2791..45ebc1bb3356 100644
> --- a/xen/include/xen/vpci.h
> +++ b/xen/include/xen/vpci.h
> @@ -129,6 +129,8 @@ struct vpci {
>           * upon to know whether BARs are mapped into the guest p2m.
>           */
>          bool bars_mapped      : 1;
> +        /* Device has the Resizable BARs capability. */
> +        bool bars_resizable   : 1;
>          /* FIXME: currently there's no support for SR-IOV. */
>      } header;
>  

-- 
Best regards,
Jiqian Chen.
 __  __            _  _    ____   ___                     _        _     _
 \ \/ /___ _ __   | || |  |___ \ / _ \    _   _ _ __  ___| |_ __ _| |__ | | ___
  \  // _ \ '_ \  | || |_   __) | | | |__| | | | '_ \/ __| __/ _` | '_ \| |/ _ \
  /  \  __/ | | | |__   _| / __/| |_| |__| |_| | | | \__ \ || (_| | |_) | |  __/
 /_/\_\___|_| |_|    |_|(_)_____|\___/    \__,_|_| |_|___/\__\__,_|_.__/|_|\___|

(XEN) Xen version 4.20-unstable (cjq@) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 
11.4.0) debug=y Wed Nov 20 10:37:59 CST 2024
(XEN) Latest ChangeSet: Fri Nov 15 10:27:48 2024 +0800 git:16e64ebc35
(XEN) build-id: acbf58d120c00466e18ab2bbdfee94e7fe0792d1
(XEN) Bootloader: GRUB 2.06-2ubuntu14.4
(XEN) Command line: placeholder dom0=pvh dom0_mem=6G loglvl=all no-real-mode 
edd=off
(XEN) Xen image load base address: 0xc6c00000
(XEN) Video information:
(XEN)  VGA is graphics mode 2560x1440, 32 bpp
(XEN) Disc information:
(XEN)  Found 0 MBR signatures
(XEN)  Found 1 EDD information structures
(XEN) CPU Vendor: AMD, Family 23 (0x17), Model 96 (0x60), Stepping 1 (raw 
00860f01)
(XEN) EFI RAM map:
(XEN)  [0000000000000000, 000000000009efff] (usable)
(XEN)  [000000000009f000, 00000000000bffff] (reserved)
(XEN)  [0000000000100000, 0000000009afffff] (usable)
(XEN)  [0000000009b00000, 0000000009dfffff] (reserved)
(XEN)  [0000000009e00000, 0000000009efffff] (usable)
(XEN)  [0000000009f00000, 0000000009f0ffff] (ACPI NVS)
(XEN)  [0000000009f10000, 00000000bb465fff] (usable)
(XEN)  [00000000bb466000, 00000000bc565fff] (reserved)
(XEN)  [00000000bc566000, 00000000c877efff] (usable)
(XEN)  [00000000c877f000, 00000000caf7efff] (reserved)
(XEN)  [00000000caf7f000, 00000000ccf7efff] (ACPI NVS)
(XEN)  [00000000ccf7f000, 00000000ccffefff] (ACPI data)
(XEN)  [00000000ccfff000, 00000000ccffffff] (usable)
(XEN)  [00000000cd000000, 00000000cdffffff] (reserved)
(XEN)  [00000000f0000000, 00000000f7ffffff] (reserved)
(XEN)  [00000000fde00000, 00000000fdefffff] (reserved)
(XEN)  [00000000fec00000, 00000000fec01fff] (reserved)
(XEN)  [00000000fec10000, 00000000fec10fff] (reserved)
(XEN)  [00000000fec20000, 00000000fec20fff] (reserved)
(XEN)  [00000000fed80000, 00000000fed81fff] (reserved)
(XEN)  [00000000fedc0000, 00000000feddffff] (reserved)
(XEN)  [00000000fee00000, 00000000fee00fff] (reserved)
(XEN)  [00000000ff000000, 00000000fff1ffff] (reserved)
(XEN)  [0000000100000000, 000000080f33ffff] (usable)
(XEN)  [000000080f340000, 000000082fffffff] (reserved)
(XEN) BSP microcode revision: 0x08600109
(XEN) ACPI: RSDP CCFFE014, 0024 (r2 AMD   )
(XEN) ACPI: XSDT CCFDE188, 0154 (r1 AMD    Celadon         2       1000013)
(XEN) ACPI: FACP CCFE6000, 0114 (r6 AMD    Celadon         2 ACPI    40000)
(XEN) ACPI: DSDT CCFD4000, 90BF (r1 AMD    Celadon         2 ACPI    40000)
(XEN) ACPI: FACS CCEF1000, 0040
(XEN) ACPI: UEFI CCF7E000, 0236 (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: SSDT CCFF5000, 723C (r2 AMD    Celadon         2 ACPI    40000)
(XEN) ACPI: IVRS CCFF4000, 01A4 (r2 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: SSDT CCFF0000, 374A (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: SSDT CCFEF000, 0228 (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: BERT CCFEE000, 0030 (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: EINJ CCFEC000, 0150 (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: SSDT CCFEB000, 046D (r1 AMD    Celadon      1000 ACPI    40000)
(XEN) ACPI: TPM2 CCFEA000, 0034 (r4 AMD    Celadon         2 ACPI    40000)
(XEN) ACPI: ASF! CCFE8000, 00A5 (r32 AMD    Celadon         2 ACPI    40000)
(XEN) ACPI: BOOT CCFE7000, 0028 (r1 AMD    Celadon         2 ACPI    40000)
(XEN) ACPI: HPET CCFE5000, 0038 (r1 AMD    Celadon         2 ACPI    40000)
(XEN) ACPI: APIC CCFE4000, 0138 (r4 AMD    Celadon         2 ACPI    40000)
(XEN) ACPI: MCFG CCFE3000, 003C (r1 AMD    Celadon         2 ACPI    40000)
(XEN) ACPI: SLIC CCFE2000, 0176 (r1 AMD    Celadon         2 ACPI    40000)
(XEN) ACPI: WSMT CCFDF000, 0028 (r1 AMD    Celadon         2 ACPI    40000)
(XEN) ACPI: SSDT CCFFD000, 0080 (r1 AMD    Celadon         2 ACPI    40000)
(XEN) ACPI: SSDT CCFC5000, 0164 (r1 AMD    Celadon      1000 ACPI    40000)
(XEN) ACPI: SSDT CCFC2000, 2B80 (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: CRAT CCFC1000, 0BA8 (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: CDIT CCFC0000, 0029 (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: VFCT CCFA7000, 18CA0 (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: SSDT CCFD3000, 0139 (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: HEST CCF96000, 10874 (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: SSDT CCFED000, 028D (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: SSDT CCFD2000, 0D37 (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: SSDT CCFD0000, 10AB (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: SSDT CCFCF000, 0179 (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: SSDT CCFCD000, 154F (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: SSDT CCFCB000, 10B3 (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: SSDT CCFCA000, 01C0 (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: SSDT CCFC6000, 30C8 (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: FPDT CCF95000, 0044 (r1 AMD    Celadon         2 ACPI    40000)
(XEN) ACPI: BGRT CCF94000, 0038 (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: SSDT CCFE1000, 007D (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: SSDT CCFE0000, 0F96 (r1 AMD    Celadon         1 ACPI    40000)
(XEN) ACPI: SSDT CCF93000, 0517 (r1 AMD    Celadon         1 ACPI    40000)
(XEN) System RAM: 32102MB (32872764kB)
(XEN) No NUMA configuration found
(XEN) Faking a node at 0000000000000000-000000080f340000
(XEN) Domain heap initialised
(XEN) vesafb: framebuffer at 0x000000fc70000000, mapped to 0xffff82c000203000, 
using 14400k, total 14400k
(XEN) vesafb: mode is 2560x1440x32, linelength=10240, font 8x16
(XEN) vesafb: Truecolor: size=8:8:8:8, shift=24:16:8:0
(XEN) SMBIOS 3.1 present.
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x408 (32 bits)
(XEN) ACPI: v5 SLEEP INFO: control[0:0], status[0:0]
(XEN) ACPI: SLEEP INFO: pm1x_cnt[1:404,1:0], pm1x_evt[1:400,1:0]
(XEN) ACPI: 32/64X FACS address mismatch in FADT - ccef1000/0000000000000000, 
using 32
(XEN) ACPI:             wakeup_vec[ccef100c], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) Overriding APIC driver with bigsmp
(XEN) ACPI: IOAPIC (id[0x21] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 33, version 33, address 0xfec00000, GSI 0-23
(XEN) ACPI: IOAPIC (id[0x22] address[0xfec01000] gsi_base[24])
(XEN) IOAPIC[1]: apic_id 34, version 33, address 0xfec01000, GSI 24-55
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) ACPI: IRQ9 used by override.
(XEN) ACPI: HPET id: 0x10228210 base: 0xfed00000
(XEN) PCI: MCFG configuration 0: base f0000000 segment 0000 buses 00 - 7f
(XEN) PCI: MCFG area at f0000000 reserved in E820
(XEN) PCI: Using MCFG for segment 0000 bus 00-7f
(XEN) HEST: Table parsing has been initialized
(XEN) ACPI: BGRT: invalidating v1 image at 0xc32b0000
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) SMP: Allowing 16 CPUs (4 hotplug CPUs)
(XEN) IRQ limits: 56 GSI, 2440 MSI/MSI-X
(XEN) Zenbleed mitigation - using chickenbit
(XEN) CPU0: 1400 ... 3000 MHz
(XEN) xstate: size: 0x380 and states: 0x207
(XEN) CPU0: AMD Fam17h machine check reporting enabled
(XEN) Speculative mitigation facilities:
(XEN)   Hardware hints: IBRS_FAST IBRS_SAME_MODE
(XEN)   Hardware features: IBPB IBRS STIBP SSBD
(XEN)   Compiled-in support: INDIRECT_THUNK SHADOW_PAGING HARDEN_ARRAY 
HARDEN_BRANCH HARDEN_GUEST_ACCESS HARDEN_LOCK
(XEN)   Xen settings: BTI-Thunk: RETPOLINE, SPEC_CTRL: IBRS- STIBP+ SSBD-, 
Other: BRANCH_HARDEN
(XEN)   Support for HVM VMs: MSR_SPEC_CTRL MSR_VIRT_SPEC_CTRL RSB IBPB-entry
(XEN)   Support for PV VMs: IBPB-entry
(XEN)   XPTI (64-bit PV only): Dom0 disabled, DomU disabled (without PCID)
(XEN)   PV L1TF shadowing: Dom0 disabled, DomU disabled
(XEN) Using scheduler: SMP Credit Scheduler rev2 (credit2)
(XEN) Initializing Credit2 scheduler
(XEN)  load_precision_shift: 18
(XEN)  load_window_shift: 30
(XEN)  underload_balance_tolerance: 0
(XEN)  overload_balance_tolerance: -3
(XEN)  runqueues arrangement: socket
(XEN)  cap enforcement granularity: 10ms
(XEN) load tracking window length 1073741824 ns
(XEN) Platform timer is 14.318MHz HPET
(XEN) Detected 2994.363 MHz processor.
(XEN) Freed 1020kB unused BSS memory
(XEN) EFI memory map:
(XEN)  0000000000000-0000000003fff type=2 attr=000000000000000f
(XEN)  0000000004000-000000008efff type=7 attr=000000000000000f
(XEN)  000000008f000-000000009efff type=2 attr=000000000000000f
(XEN)  000000009f000-000000009ffff type=0 attr=000000000000000f
(XEN)  0000000100000-0000004ac3fff type=2 attr=000000000000000f
(XEN)  0000004ac4000-0000009afffff type=7 attr=000000000000000f
(XEN)  0000009b00000-0000009dfffff type=0 attr=000000000000000f
(XEN)  0000009e00000-0000009efffff type=7 attr=000000000000000f
(XEN)  0000009f00000-0000009f0ffff type=10 attr=000000000000000f
(XEN)  0000009f10000-0000078d3afff type=7 attr=000000000000000f
(XEN)  0000078d3b000-000007fffefff type=1 attr=000000000000000f
(XEN)  000007ffff000-00000b6e88fff type=7 attr=000000000000000f
(XEN)  00000b6e89000-00000b7103fff type=1 attr=000000000000000f
(XEN)  00000b7104000-00000b737efff type=2 attr=000000000000000f
(XEN)  00000b737f000-00000b739efff type=4 attr=000000000000000f
(XEN)  00000b739f000-00000b73f7fff type=7 attr=000000000000000f
(XEN)  00000b73f8000-00000b7619fff type=4 attr=000000000000000f
(XEN)  00000b761a000-00000b7667fff type=3 attr=000000000000000f
(XEN)  00000b7668000-00000baf86fff type=4 attr=000000000000000f
(XEN)  00000baf87000-00000bafa5fff type=3 attr=000000000000000f
(XEN)  00000bafa6000-00000baff7fff type=4 attr=000000000000000f
(XEN)  00000baff8000-00000bb05dfff type=3 attr=000000000000000f
(XEN)  00000bb05e000-00000bb465fff type=4 attr=000000000000000f
(XEN)  00000bb466000-00000bc565fff type=0 attr=000000000000000f
(XEN)  00000bc566000-00000bc56ffff type=3 attr=000000000000000f
(XEN)  00000bc570000-00000bc579fff type=7 attr=000000000000000f
(XEN)  00000bc57a000-00000bc57cfff type=2 attr=000000000000000f
(XEN)  00000bc57d000-00000bc6a8fff type=7 attr=000000000000000f
(XEN)  00000bc6a9000-00000bc77efff type=1 attr=000000000000000f
(XEN)  00000bc77f000-00000c3160fff type=7 attr=000000000000000f
(XEN)  00000c3161000-00000c32a1fff type=4 attr=000000000000000f
(XEN)  00000c32a2000-00000c32abfff type=7 attr=000000000000000f
(XEN)  00000c32ac000-00000c32acfff type=4 attr=000000000000000f
(XEN)  00000c32ad000-00000c32adfff type=7 attr=000000000000000f
(XEN)  00000c32ae000-00000c677efff type=4 attr=000000000000000f
(XEN)  00000c677f000-00000c6dfffff type=7 attr=000000000000000f
(XEN)  00000c6e00000-00000c71f7fff type=2 attr=000000000000000f
(XEN)  00000c71f8000-00000c737afff type=7 attr=000000000000000f
(XEN)  00000c737b000-00000c877efff type=3 attr=000000000000000f
(XEN)  00000c877f000-00000c8f7efff type=5 attr=800000000000000f
(XEN)  00000c8f7f000-00000c9f7efff type=6 attr=800000000000000f
(XEN)  00000c9f7f000-00000caf7efff type=0 attr=000000000000000f
(XEN)  00000caf7f000-00000ccf7efff type=10 attr=000000000000000f
(XEN)  00000ccf7f000-00000ccffefff type=9 attr=000000000000000f
(XEN)  00000ccfff000-00000ccffffff type=4 attr=000000000000000f
(XEN)  0000100000000-000080f33ffff type=7 attr=000000000000000f
(XEN)  00000000a0000-00000000bffff type=0 attr=0000000000000000
(XEN)  00000cd000000-00000cdffffff type=0 attr=0000000000000000
(XEN)  00000f0000000-00000f7ffffff type=11 attr=8000000000000001
(XEN)  00000fde00000-00000fdefffff type=11 attr=8000000000000001
(XEN)  00000fec00000-00000fec01fff type=11 attr=8000000000000001
(XEN)  00000fec10000-00000fec10fff type=11 attr=8000000000000001
(XEN)  00000fec20000-00000fec20fff type=11 attr=8000000000000001
(XEN)  00000fed80000-00000fed81fff type=11 attr=8000000000000001
(XEN)  00000fedc0000-00000feddffff type=11 attr=8000000000000001
(XEN)  00000fee00000-00000fee00fff type=11 attr=8000000000000001
(XEN)  00000ff000000-00000fff1ffff type=11 attr=8000000000000001
(XEN)  000080f340000-000082fffffff type=0 attr=0000000000000000
(XEN) alt table ffff82d04049c1b8 -> ffff82d0404aeca4
(XEN) AMD-Vi: IOMMU Extended Features:
(XEN) - Peripheral Page Service Request
(XEN) - x2APIC
(XEN) - NX bit
(XEN) - Invalidate All Command
(XEN) - Guest APIC
(XEN) - Performance Counters
(XEN) - Host Address Translation Size: 0x2
(XEN) - Guest Address Translation Size: 0
(XEN) - Guest CR3 Root Table Level: 0x1
(XEN) - Maximum PASID: 0xf
(XEN) - SMI Filter Register: 0x1
(XEN) - SMI Filter Register Count: 0x1
(XEN) - Guest Virtual APIC Modes: 0x1
(XEN) - Dual PPR Log: 0x2
(XEN) - Dual Event Log: 0x2
(XEN) - User / Supervisor Page Protection
(XEN) - Device Table Segmentation: 0x3
(XEN) - PPR Log Overflow Early Warning
(XEN) - PPR Automatic Response
(XEN) - Memory Access Routing and Control: 0
(XEN) - Block StopMark Message
(XEN) - Performance Optimization
(XEN) - MSI Capability MMIO Access
(XEN) - Guest I/O Protection
(XEN) - Enhanced PPR Handling
(XEN) - Attribute Forward
(XEN) - Invalidate IOTLB Type
(XEN) - VM Table Size: 0
(XEN) - Guest Access Bit Update Disable
(XEN) AMD-Vi: Disabled HAP memory map sharing with IOMMU
(XEN) AMD-Vi: IOMMU 0 Enabled.
(XEN) I/O virtualisation enabled
(XEN)  - Dom0 mode: Relaxed
(XEN) Interrupt remapping enabled
(XEN) nr_sockets: 2
(XEN) Enabling APIC mode.  Using 2 I/O APICs
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using new ACK method
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) Wallclock source: EFI
(XEN) Allocated console ring of 128 KiB.
(XEN) mwait-idle: does not run on family 23 model 96
(XEN) HVM: ASIDs enabled.
(XEN) SVM: Supported advanced features:
(XEN)  - Nested Page Tables (NPT)
(XEN)  - Last Branch Record (LBR) Virtualisation
(XEN)  - Next-RIP Saved on #VMEXIT
(XEN)  - VMCB Clean Bits
(XEN)  - TLB flush by ASID
(XEN)  - DecodeAssists
(XEN)  - Virtual VMLOAD/VMSAVE
(XEN)  - Virtual GIF
(XEN)  - Pause-Intercept Filter
(XEN)  - Pause-Intercept Filter Threshold
(XEN)  - TSC Rate MSR
(XEN)  - MSR_SPEC_CTRL virtualisation
(XEN) HVM: SVM enabled
(XEN) HVM: Hardware Assisted Paging (HAP) detected
(XEN) HVM: HAP page sizes: 4kB, 2MB, 1GB
(XEN) alt table ffff82d04049c1b8 -> ffff82d0404aeca4
(XEN) Brought up 12 CPUs
(XEN) Scheduling granularity: cpu, 1 CPU per sched-resource
(XEN) Initializing Credit2 scheduler
(XEN)  load_precision_shift: 18
(XEN)  load_window_shift: 30
(XEN)  underload_balance_tolerance: 0
(XEN)  overload_balance_tolerance: -3
(XEN)  runqueues arrangement: socket
(XEN)  cap enforcement granularity: 10ms
(XEN) load tracking window length 1073741824 ns
(XEN) Adding cpu 0 to runqueue 0
(XEN)  First cpu on runqueue, activating
(XEN) Adding cpu 1 to runqueue 0
(XEN) Adding cpu 2 to runqueue 0
(XEN) Adding cpu 3 to runqueue 0
(XEN) Adding cpu 4 to runqueue 0
(XEN) Adding cpu 5 to runqueue 0
(XEN) Adding cpu 6 to runqueue 0
(XEN) Adding cpu 7 to runqueue 0
(XEN) Adding cpu 8 to runqueue 0
(XEN) Adding cpu 9 to runqueue 0
(XEN) Adding cpu 10 to runqueue 0
(XEN) Adding cpu 11 to runqueue 0
(XEN) mcheck_poll: Machine check polling timer started.
(XEN) Running stub recovery selftests...
(XEN) Fixup #UD[0000]: ffff82d07fffe044 [ffff82d07fffe044] -> ffff82d04038cd5c
(XEN) Fixup #GP[0000]: ffff82d07fffe045 [ffff82d07fffe045] -> ffff82d04038cd5c
(XEN) Fixup #SS[0000]: ffff82d07fffe044 [ffff82d07fffe044] -> ffff82d04038cd5c
(XEN) Fixup #BP[0000]: ffff82d07fffe045 [ffff82d07fffe045] -> ffff82d04038cd5c
(XEN) NX (Execute Disable) protection active
(XEN) *** Building a PVH Dom0 ***
(XEN) 0000:00:01.1: modify bars cmd: 7 rom_only: 0
(XEN) 0000:00:02.4: modify bars cmd: 7 rom_only: 0
(XEN) 0000:00:08.1: modify bars cmd: 7 rom_only: 0
(XEN) 0000:00:08.2: modify bars cmd: 7 rom_only: 0
(XEN) 0000:00:14.0: modify bars cmd: 403 rom_only: 0
(XEN) 0000:00:14.3: modify bars cmd: f rom_only: 0
(XEN) 0000:01:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:02:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:03:00.0: modify bars cmd: 6 rom_only: 0
(XEN) 0000:03:00.0: BAR0 ReBAR supported addr 0xfc90000000 -> 0xfc90000000 size 
0x10000000 -> 0x10000000
(XEN) 0000:03:00.0: BAR2 ReBAR supported addr 0xfca0000000 -> 0xfca0000000 size 
0x200000 -> 0x200000
(XEN) 0000:03:00.0: BAR5 ReBAR supported addr 0xd0600000 -> 0xd0600000 size 
0x100000 -> 0x100000
(XEN) 0000:03:00.1: modify bars cmd: 3 rom_only: 0
(XEN) 0000:04:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:05:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:05:00.1: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.2: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.3: modify bars cmd: 7 rom_only: 0
(XEN) 0000:05:00.4: modify bars cmd: 7 rom_only: 0
(XEN) 0000:05:00.5: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.6: modify bars cmd: 3 rom_only: 0
(XEN) 0000:06:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:06:00.1: modify bars cmd: 7 rom_only: 0
(XEN) 0000:06:00.2: modify bars cmd: 3 rom_only: 0
(XEN) 0000:06:00.3: modify bars cmd: 3 rom_only: 0
(XEN) Dom0 memory allocation stats:
(XEN) order  0 allocations: 4
(XEN) order  1 allocations: 4
(XEN) order  2 allocations: 3
(XEN) order  3 allocations: 3
(XEN) order  4 allocations: 5
(XEN) order  5 allocations: 4
(XEN) order  6 allocations: 4
(XEN) order  7 allocations: 4
(XEN) order  8 allocations: 4
(XEN) order  9 allocations: 4
(XEN) order 10 allocations: 4
(XEN) order 11 allocations: 4
(XEN) order 12 allocations: 4
(XEN) order 13 allocations: 4
(XEN) order 14 allocations: 2
(XEN) order 15 allocations: 3
(XEN) order 16 allocations: 3
(XEN) order 17 allocations: 3
(XEN) order 18 allocations: 3
(XEN) ELF: phdr: paddr=0x1000000 memsz=0x195f668
(XEN) ELF: phdr: paddr=0x2a00000 memsz=0x96f000
(XEN) ELF: phdr: paddr=0x336f000 memsz=0x39000
(XEN) ELF: phdr: paddr=0x33a8000 memsz=0x1458000
(XEN) ELF: memory: 0x1000000 -> 0x4800000
(XEN) ELF: note: PHYS32_RELOC align: 0x200000 min: 0x1000000 max: 0x3fffffff
(XEN) ELF: note: PHYS32_ENTRY = 0x1000a20
(XEN) ELF: note: GUEST_OS = "linux"
(XEN) ELF: note: GUEST_VERSION = "2.6"
(XEN) ELF: note: XEN_VERSION = "xen-3.0"
(XEN) ELF: note: VIRT_BASE = 0xffffffff80000000
(XEN) ELF: note: INIT_P2M = 0x8000000000
(XEN) ELF: note: ENTRY = 0xffffffff833bc620
(XEN) ELF: note: FEATURES = "!writable_page_tables"
(XEN) ELF: note: PAE_MODE = "yes"
(XEN) ELF: note: L1_MFN_VALID
(XEN) ELF: note: MOD_START_PFN = 0x1
(XEN) ELF: note: PADDR_OFFSET = 0
(XEN) ELF: note: HYPERCALL_PAGE = 0xffffffff81f38000
(XEN) ELF: note: SUPPORTED_FEATURES = 0x8801
(XEN) ELF: note: LOADER = "generic"
(XEN) ELF: note: SUSPEND_CANCEL = 0x1
(XEN) ELF: Found PVH image
(XEN) ELF: addresses:
(XEN)     virt_base        = 0x0
(XEN)     elf_paddr_offset = 0x0
(XEN)     virt_offset      = 0x0
(XEN)     virt_kstart      = 0x1000000
(XEN)     virt_kend        = 0x4800000
(XEN)     virt_entry       = 0x1000a20
(XEN)     p2m_base         = 0x8000000000
(XEN) ELF: phdr 0 at 0x1000000 -> 0x295f668
(XEN) ELF: phdr 1 at 0x2a00000 -> 0x336f000
(XEN) ELF: phdr 2 at 0x336f000 -> 0x33a8000
(XEN) ELF: phdr 3 at 0x33a8000 -> 0x4800000
(XEN) Dom0 memory map:
(XEN)  [0000000000000000, 000000000009efff] (usable)
(XEN)  [000000000009f000, 00000000000bffff] (reserved)
(XEN)  [0000000000100000, 0000000009afffff] (usable)
(XEN)  [0000000009b00000, 0000000009dfffff] (reserved)
(XEN)  [0000000009e00000, 0000000009efffff] (usable)
(XEN)  [0000000009f00000, 0000000009f0ffff] (ACPI NVS)
(XEN)  [0000000009f10000, 00000000bb465fff] (usable)
(XEN)  [00000000bb466000, 00000000bc565fff] (reserved)
(XEN)  [00000000bc566000, 00000000c877efff] (usable)
(XEN)  [00000000c877f000, 00000000caf7efff] (reserved)
(XEN)  [00000000caf7f000, 00000000ccf7efff] (ACPI NVS)
(XEN)  [00000000ccf7f000, 00000000ccffefff] (ACPI data)
(XEN)  [00000000ccfff000, 00000000ccfffdd7] (usable)
(XEN)  [00000000ccfffdd8, 00000000ccfffeef] (ACPI data)
(XEN)  [00000000cd000000, 00000000cdffffff] (reserved)
(XEN)  [00000000f0000000, 00000000f7ffffff] (reserved)
(XEN)  [00000000fde00000, 00000000fdefffff] (reserved)
(XEN)  [00000000fec00000, 00000000fec01fff] (reserved)
(XEN)  [00000000fec10000, 00000000fec10fff] (reserved)
(XEN)  [00000000fec20000, 00000000fec20fff] (reserved)
(XEN)  [00000000fed80000, 00000000fed81fff] (reserved)
(XEN)  [00000000fedc0000, 00000000feddffff] (reserved)
(XEN)  [00000000fee00000, 00000000fee00fff] (reserved)
(XEN)  [00000000ff000000, 00000000fff1ffff] (reserved)
(XEN)  [0000000100000000, 00000001b8cf0fff] (usable)
(XEN)  [00000001b8cf1000, 000000080f33ffff] (unusable)
(XEN)  [000000080f340000, 000000082fffffff] (reserved)
(XEN) Initial low memory virq threshold set at 0x4000 pages.
(XEN) Scrubbing Free RAM in background
(XEN) Std. Loglevel: All
(XEN) Guest Loglevel: All
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input to DOM0 (type 'CTRL-a' three times to switch input)
(XEN) Freed 652kB init memory
(XEN) d0v0: upcall vector f3
(XEN) PCI add device 0000:00:00.0
(XEN) PCI add device 0000:00:00.2
(XEN) PCI add device 0000:00:01.0
(XEN) 0000:00:01.1: modify bars cmd: 4 rom_only: 0
(XEN) 0000:00:01.1: modify bars cmd: 7 rom_only: 0
(XEN) 0000:00:01.1: modify bars cmd: 4 rom_only: 0
(XEN) 0000:00:01.1: modify bars cmd: 7 rom_only: 0
(XEN) 0000:00:01.1: modify bars cmd: 4 rom_only: 0
(XEN) 0000:00:01.1: modify bars cmd: 7 rom_only: 0
(XEN) PCI add device 0000:00:01.1
(XEN) PCI add device 0000:00:02.0
(XEN) 0000:00:02.4: modify bars cmd: 4 rom_only: 0
(XEN) 0000:00:02.4: modify bars cmd: 7 rom_only: 0
(XEN) 0000:00:02.4: modify bars cmd: 4 rom_only: 0
(XEN) 0000:00:02.4: modify bars cmd: 7 rom_only: 0
(XEN) 0000:00:02.4: modify bars cmd: 4 rom_only: 0
(XEN) 0000:00:02.4: modify bars cmd: 7 rom_only: 0
(XEN) PCI add device 0000:00:02.4
(XEN) PCI add device 0000:00:08.0
(XEN) 0000:00:08.1: modify bars cmd: 4 rom_only: 0
(XEN) 0000:00:08.1: modify bars cmd: 7 rom_only: 0
(XEN) 0000:00:08.1: modify bars cmd: 4 rom_only: 0
(XEN) 0000:00:08.1: modify bars cmd: 7 rom_only: 0
(XEN) 0000:00:08.1: modify bars cmd: 4 rom_only: 0
(XEN) 0000:00:08.1: modify bars cmd: 7 rom_only: 0
(XEN) PCI add device 0000:00:08.1
(XEN) 0000:00:08.2: modify bars cmd: 4 rom_only: 0
(XEN) 0000:00:08.2: modify bars cmd: 7 rom_only: 0
(XEN) 0000:00:08.2: modify bars cmd: 4 rom_only: 0
(XEN) 0000:00:08.2: modify bars cmd: 7 rom_only: 0
(XEN) 0000:00:08.2: modify bars cmd: 4 rom_only: 0
(XEN) 0000:00:08.2: modify bars cmd: 7 rom_only: 0
(XEN) PCI add device 0000:00:08.2
(XEN) 0000:00:14.0: modify bars cmd: 400 rom_only: 0
(XEN) 0000:00:14.0: modify bars cmd: 403 rom_only: 0
(XEN) 0000:00:14.0: modify bars cmd: 400 rom_only: 0
(XEN) 0000:00:14.0: modify bars cmd: 403 rom_only: 0
(XEN) 0000:00:14.0: modify bars cmd: 400 rom_only: 0
(XEN) 0000:00:14.0: modify bars cmd: 403 rom_only: 0
(XEN) 0000:00:14.0: modify bars cmd: 400 rom_only: 0
(XEN) 0000:00:14.0: modify bars cmd: 403 rom_only: 0
(XEN) 0000:00:14.0: modify bars cmd: 400 rom_only: 0
(XEN) 0000:00:14.0: modify bars cmd: 403 rom_only: 0
(XEN) 0000:00:14.0: modify bars cmd: 400 rom_only: 0
(XEN) 0000:00:14.0: modify bars cmd: 403 rom_only: 0
(XEN) 0000:00:14.0: modify bars cmd: 400 rom_only: 0
(XEN) 0000:00:14.0: modify bars cmd: 403 rom_only: 0
(XEN) PCI add device 0000:00:14.0
(XEN) 0000:00:14.3: modify bars cmd: c rom_only: 0
(XEN) 0000:00:14.3: modify bars cmd: f rom_only: 0
(XEN) 0000:00:14.3: modify bars cmd: c rom_only: 0
(XEN) 0000:00:14.3: modify bars cmd: f rom_only: 0
(XEN) 0000:00:14.3: modify bars cmd: c rom_only: 0
(XEN) 0000:00:14.3: modify bars cmd: f rom_only: 0
(XEN) 0000:00:14.3: modify bars cmd: c rom_only: 0
(XEN) 0000:00:14.3: modify bars cmd: f rom_only: 0
(XEN) 0000:00:14.3: modify bars cmd: c rom_only: 0
(XEN) 0000:00:14.3: modify bars cmd: f rom_only: 0
(XEN) 0000:00:14.3: modify bars cmd: c rom_only: 0
(XEN) 0000:00:14.3: modify bars cmd: f rom_only: 0
(XEN) 0000:00:14.3: modify bars cmd: c rom_only: 0
(XEN) 0000:00:14.3: modify bars cmd: f rom_only: 0
(XEN) PCI add device 0000:00:14.3
(XEN) PCI add device 0000:00:18.0
(XEN) PCI add device 0000:00:18.1
(XEN) PCI add device 0000:00:18.2
(XEN) PCI add device 0000:00:18.3
(XEN) PCI add device 0000:00:18.4
(XEN) PCI add device 0000:00:18.5
(XEN) PCI add device 0000:00:18.6
(XEN) PCI add device 0000:00:18.7
(XEN) 0000:01:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:01:00.0: write BAR0 val: 0xfffffff0 BAR0 address: 0xfffffff0
(XEN) 0000:01:00.0: write BAR0 val: 0xd0800000 BAR0 address: 0xd0800000
(XEN) 0000:01:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:01:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:01:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:01:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:01:00.0: modify bars cmd: 7 rom_only: 0
(XEN) PCI add device 0000:01:00.0
(XEN) 0000:02:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:02:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:02:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:02:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:02:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:02:00.0: modify bars cmd: 7 rom_only: 0
(XEN) PCI add device 0000:02:00.0
(XEN) 0000:03:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:03:00.0: write BAR0 val: 0xfffffff0 BAR0 address: 0xfcfffffff0
(XEN) 0000:03:00.0: write BAR0 val: 0x90000000 BAR0 address: 0xfc90000000
(XEN) 0000:03:00.0: write BAR0 val: 0xffffffff BAR1 address: 0xffffffff90000000
(XEN) 0000:03:00.0: write BAR0 val: 0xfc BAR1 address: 0xfc90000000
(XEN) 0000:03:00.0: modify bars cmd: 6 rom_only: 0
(XEN) 0000:03:00.0: BAR0 ReBAR supported addr 0xfc90000000 -> 0xfc90000000 size 
0x10000000 -> 0x10000000
(XEN) 0000:03:00.0: BAR2 ReBAR supported addr 0xfca0000000 -> 0xfca0000000 size 
0x200000 -> 0x200000
(XEN) 0000:03:00.0: BAR5 ReBAR supported addr 0xd0600000 -> 0xd0600000 size 
0x100000 -> 0x100000
(XEN) 0000:03:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:03:00.0: write BAR2 val: 0xfffffff0 BAR2 address: 0xfcfffffff0
(XEN) 0000:03:00.0: write BAR2 val: 0xa0000000 BAR2 address: 0xfca0000000
(XEN) 0000:03:00.0: write BAR2 val: 0xffffffff BAR3 address: 0xffffffffa0000000
(XEN) 0000:03:00.0: write BAR2 val: 0xfc BAR3 address: 0xfca0000000
(XEN) 0000:03:00.0: modify bars cmd: 6 rom_only: 0
(XEN) 0000:03:00.0: BAR0 ReBAR supported addr 0xfc90000000 -> 0xfc90000000 size 
0x10000000 -> 0x10000000
(XEN) 0000:03:00.0: BAR2 ReBAR supported addr 0xfca0000000 -> 0xfca0000000 size 
0x200000 -> 0x200000
(XEN) 0000:03:00.0: BAR5 ReBAR supported addr 0xd0600000 -> 0xd0600000 size 
0x100000 -> 0x100000
(XEN) 0000:03:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:03:00.0: modify bars cmd: 6 rom_only: 0
(XEN) 0000:03:00.0: BAR0 ReBAR supported addr 0xfc90000000 -> 0xfc90000000 size 
0x10000000 -> 0x10000000
(XEN) 0000:03:00.0: BAR2 ReBAR supported addr 0xfca0000000 -> 0xfca0000000 size 
0x200000 -> 0x200000
(XEN) 0000:03:00.0: BAR5 ReBAR supported addr 0xd0600000 -> 0xd0600000 size 
0x100000 -> 0x100000
(XEN) 0000:03:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:03:00.0: write BAR5 val: 0xfffffff0 BAR5 address: 0xfffffff0
(XEN) 0000:03:00.0: write BAR5 val: 0xd0600000 BAR5 address: 0xd0600000
(XEN) 0000:03:00.0: modify bars cmd: 6 rom_only: 0
(XEN) 0000:03:00.0: BAR0 ReBAR supported addr 0xfc90000000 -> 0xfc90000000 size 
0x10000000 -> 0x10000000
(XEN) 0000:03:00.0: BAR2 ReBAR supported addr 0xfca0000000 -> 0xfca0000000 size 
0x200000 -> 0x200000
(XEN) 0000:03:00.0: BAR5 ReBAR supported addr 0xd0600000 -> 0xd0600000 size 
0x100000 -> 0x100000
(XEN) 0000:03:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:03:00.0: modify bars cmd: 6 rom_only: 0
(XEN) 0000:03:00.0: BAR0 ReBAR supported addr 0xfc90000000 -> 0xfc90000000 size 
0x10000000 -> 0x10000000
(XEN) 0000:03:00.0: BAR2 ReBAR supported addr 0xfca0000000 -> 0xfca0000000 size 
0x200000 -> 0x200000
(XEN) 0000:03:00.0: BAR5 ReBAR supported addr 0xd0600000 -> 0xd0600000 size 
0x100000 -> 0x100000
(XEN) PCI add device 0000:03:00.0
(XEN) 0000:03:00.1: modify bars cmd: 0 rom_only: 0
(XEN) 0000:03:00.1: write BAR0 val: 0xfffffff0 BAR0 address: 0xfffffff0
(XEN) 0000:03:00.1: write BAR0 val: 0xd0700000 BAR0 address: 0xd0700000
(XEN) 0000:03:00.1: modify bars cmd: 3 rom_only: 0
(XEN) 0000:03:00.1: modify bars cmd: 0 rom_only: 0
(XEN) 0000:03:00.1: modify bars cmd: 3 rom_only: 0
(XEN) 0000:03:00.1: modify bars cmd: 0 rom_only: 0
(XEN) 0000:03:00.1: modify bars cmd: 3 rom_only: 0
(XEN) 0000:03:00.1: modify bars cmd: 0 rom_only: 0
(XEN) 0000:03:00.1: modify bars cmd: 3 rom_only: 0
(XEN) 0000:03:00.1: modify bars cmd: 0 rom_only: 0
(XEN) 0000:03:00.1: modify bars cmd: 3 rom_only: 0
(XEN) 0000:03:00.1: modify bars cmd: 0 rom_only: 0
(XEN) 0000:03:00.1: modify bars cmd: 3 rom_only: 0
(XEN) 0000:03:00.1: modify bars cmd: 0 rom_only: 0
(XEN) 0000:03:00.1: modify bars cmd: 3 rom_only: 0
(XEN) PCI add device 0000:03:00.1
(XEN) 0000:04:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:04:00.0: write BAR0 val: 0xfffffff0 BAR0 address: 0xfffffff0
(XEN) 0000:04:00.0: write BAR0 val: 0xd0500000 BAR0 address: 0xd0500000
(XEN) 0000:04:00.0: write BAR0 val: 0xffffffff BAR1 address: 0xffffffffd0500000
(XEN) 0000:04:00.0: write BAR0 val: 0 BAR1 address: 0xd0500000
(XEN) 0000:04:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:04:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:04:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:04:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:04:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:04:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:04:00.0: write BAR4 val: 0xfffffff0 BAR4 address: 0xfffffff0
(XEN) 0000:04:00.0: write BAR4 val: 0xd0504000 BAR4 address: 0xd0504000
(XEN) 0000:04:00.0: write BAR4 val: 0xffffffff BAR5 address: 0xffffffffd0504000
(XEN) 0000:04:00.0: write BAR4 val: 0 BAR5 address: 0xd0504000
(XEN) 0000:04:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:04:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:04:00.0: modify bars cmd: 7 rom_only: 0
(XEN) PCI add device 0000:04:00.0
(XEN) 0000:05:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:05:00.0: write BAR0 val: 0xfffffff0 BAR0 address: 0xfcfffffff0
(XEN) 0000:05:00.0: write BAR0 val: 0x70000000 BAR0 address: 0xfc70000000
(XEN) 0000:05:00.0: write BAR0 val: 0xffffffff BAR1 address: 0xffffffff70000000
(XEN) 0000:05:00.0: write BAR0 val: 0xfc BAR1 address: 0xfc70000000
(XEN) 0000:05:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:05:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:05:00.0: write BAR2 val: 0xfffffff0 BAR2 address: 0xfcfffffff0
(XEN) 0000:05:00.0: write BAR2 val: 0x80000000 BAR2 address: 0xfc80000000
(XEN) 0000:05:00.0: write BAR2 val: 0xffffffff BAR3 address: 0xffffffff80000000
(XEN) 0000:05:00.0: write BAR2 val: 0xfc BAR3 address: 0xfc80000000
(XEN) 0000:05:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:05:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:05:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:05:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:05:00.0: write BAR5 val: 0xfffffff0 BAR5 address: 0xfffffff0
(XEN) 0000:05:00.0: write BAR5 val: 0xd0400000 BAR5 address: 0xd0400000
(XEN) 0000:05:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:05:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:05:00.0: modify bars cmd: 7 rom_only: 0
(XEN) PCI add device 0000:05:00.0
(XEN) 0000:05:00.1: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.1: write BAR0 val: 0xfffffff0 BAR0 address: 0xfffffff0
(XEN) 0000:05:00.1: write BAR0 val: 0xd04c8000 BAR0 address: 0xd04c8000
(XEN) 0000:05:00.1: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.1: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.1: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.1: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.1: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.1: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.1: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.1: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.1: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.1: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.1: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.1: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.1: modify bars cmd: 3 rom_only: 0
(XEN) PCI add device 0000:05:00.1
(XEN) 0000:05:00.2: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.2: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.2: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.2: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.2: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.2: write BAR2 val: 0xfffffff0 BAR2 address: 0xfffffff0
(XEN) 0000:05:00.2: write BAR2 val: 0xd0300000 BAR2 address: 0xd0300000
(XEN) 0000:05:00.2: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.2: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.2: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.2: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.2: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.2: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.2: write BAR5 val: 0xfffffff0 BAR5 address: 0xfffffff0
(XEN) 0000:05:00.2: write BAR5 val: 0xd04cc000 BAR5 address: 0xd04cc000
(XEN) 0000:05:00.2: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.2: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.2: modify bars cmd: 3 rom_only: 0
(XEN) PCI add device 0000:05:00.2
(XEN) 0000:05:00.3: modify bars cmd: 4 rom_only: 0
(XEN) 0000:05:00.3: write BAR0 val: 0xfffffff0 BAR0 address: 0xfffffff0
(XEN) 0000:05:00.3: write BAR0 val: 0xd0200000 BAR0 address: 0xd0200000
(XEN) 0000:05:00.3: write BAR0 val: 0xffffffff BAR1 address: 0xffffffffd0200000
(XEN) 0000:05:00.3: write BAR0 val: 0 BAR1 address: 0xd0200000
(XEN) 0000:05:00.3: modify bars cmd: 7 rom_only: 0
(XEN) 0000:05:00.3: modify bars cmd: 4 rom_only: 0
(XEN) 0000:05:00.3: modify bars cmd: 7 rom_only: 0
(XEN) 0000:05:00.3: modify bars cmd: 4 rom_only: 0
(XEN) 0000:05:00.3: modify bars cmd: 7 rom_only: 0
(XEN) 0000:05:00.3: modify bars cmd: 4 rom_only: 0
(XEN) 0000:05:00.3: modify bars cmd: 7 rom_only: 0
(XEN) 0000:05:00.3: modify bars cmd: 4 rom_only: 0
(XEN) 0000:05:00.3: modify bars cmd: 7 rom_only: 0
(XEN) 0000:05:00.3: modify bars cmd: 4 rom_only: 0
(XEN) 0000:05:00.3: modify bars cmd: 7 rom_only: 0
(XEN) PCI add device 0000:05:00.3
(XEN) 0000:05:00.4: modify bars cmd: 4 rom_only: 0
(XEN) 0000:05:00.4: write BAR0 val: 0xfffffff0 BAR0 address: 0xfffffff0
(XEN) 0000:05:00.4: write BAR0 val: 0xd0100000 BAR0 address: 0xd0100000
(XEN) 0000:05:00.4: write BAR0 val: 0xffffffff BAR1 address: 0xffffffffd0100000
(XEN) 0000:05:00.4: write BAR0 val: 0 BAR1 address: 0xd0100000
(XEN) 0000:05:00.4: modify bars cmd: 7 rom_only: 0
(XEN) 0000:05:00.4: modify bars cmd: 4 rom_only: 0
(XEN) 0000:05:00.4: modify bars cmd: 7 rom_only: 0
(XEN) 0000:05:00.4: modify bars cmd: 4 rom_only: 0
(XEN) 0000:05:00.4: modify bars cmd: 7 rom_only: 0
(XEN) 0000:05:00.4: modify bars cmd: 4 rom_only: 0
(XEN) 0000:05:00.4: modify bars cmd: 7 rom_only: 0
(XEN) 0000:05:00.4: modify bars cmd: 4 rom_only: 0
(XEN) 0000:05:00.4: modify bars cmd: 7 rom_only: 0
(XEN) 0000:05:00.4: modify bars cmd: 4 rom_only: 0
(XEN) 0000:05:00.4: modify bars cmd: 7 rom_only: 0
(XEN) PCI add device 0000:05:00.4
(XEN) 0000:05:00.5: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.5: write BAR0 val: 0xfffffff0 BAR0 address: 0xfffffff0
(XEN) 0000:05:00.5: write BAR0 val: 0xd0480000 BAR0 address: 0xd0480000
(XEN) 0000:05:00.5: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.5: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.5: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.5: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.5: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.5: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.5: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.5: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.5: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.5: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.5: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.5: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.5: modify bars cmd: 3 rom_only: 0
(XEN) PCI add device 0000:05:00.5
(XEN) 0000:05:00.6: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.6: write BAR0 val: 0xfffffff0 BAR0 address: 0xfffffff0
(XEN) 0000:05:00.6: write BAR0 val: 0xd04c0000 BAR0 address: 0xd04c0000
(XEN) 0000:05:00.6: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.6: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.6: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.6: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.6: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.6: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.6: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.6: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.6: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.6: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.6: modify bars cmd: 3 rom_only: 0
(XEN) 0000:05:00.6: modify bars cmd: 0 rom_only: 0
(XEN) 0000:05:00.6: modify bars cmd: 3 rom_only: 0
(XEN) PCI add device 0000:05:00.6
(XEN) 0000:06:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:06:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:06:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:06:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:06:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:06:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:06:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:06:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:06:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:06:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:06:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:06:00.0: write BAR5 val: 0xfffffff0 BAR5 address: 0xfffffff0
(XEN) 0000:06:00.0: write BAR5 val: 0xd0085000 BAR5 address: 0xd0085000
(XEN) 0000:06:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:06:00.0: modify bars cmd: 4 rom_only: 0
(XEN) 0000:06:00.0: modify bars cmd: 7 rom_only: 0
(XEN) PCI add device 0000:06:00.0
(XEN) 0000:06:00.1: modify bars cmd: 4 rom_only: 0
(XEN) 0000:06:00.1: modify bars cmd: 7 rom_only: 0
(XEN) 0000:06:00.1: modify bars cmd: 4 rom_only: 0
(XEN) 0000:06:00.1: modify bars cmd: 7 rom_only: 0
(XEN) 0000:06:00.1: modify bars cmd: 4 rom_only: 0
(XEN) 0000:06:00.1: modify bars cmd: 7 rom_only: 0
(XEN) 0000:06:00.1: modify bars cmd: 4 rom_only: 0
(XEN) 0000:06:00.1: modify bars cmd: 7 rom_only: 0
(XEN) 0000:06:00.1: modify bars cmd: 4 rom_only: 0
(XEN) 0000:06:00.1: modify bars cmd: 7 rom_only: 0
(XEN) 0000:06:00.1: modify bars cmd: 4 rom_only: 0
(XEN) 0000:06:00.1: write BAR5 val: 0xfffffff0 BAR5 address: 0xfffffff0
(XEN) 0000:06:00.1: write BAR5 val: 0xd0084000 BAR5 address: 0xd0084000
(XEN) 0000:06:00.1: modify bars cmd: 7 rom_only: 0
(XEN) 0000:06:00.1: modify bars cmd: 4 rom_only: 0
(XEN) 0000:06:00.1: modify bars cmd: 7 rom_only: 0
(XEN) PCI add device 0000:06:00.1
(XEN) 0000:06:00.2: modify bars cmd: 0 rom_only: 0
(XEN) 0000:06:00.2: write BAR0 val: 0xfffffff0 BAR0 address: 0xfffffff0
(XEN) 0000:06:00.2: write BAR0 val: 0xd0060000 BAR0 address: 0xd0060000
(XEN) 0000:06:00.2: modify bars cmd: 3 rom_only: 0
(XEN) 0000:06:00.2: modify bars cmd: 0 rom_only: 0
(XEN) 0000:06:00.2: write BAR1 val: 0xfffffff0 BAR1 address: 0xfffffff0
(XEN) 0000:06:00.2: write BAR1 val: 0xd0040000 BAR1 address: 0xd0040000
(XEN) 0000:06:00.2: modify bars cmd: 3 rom_only: 0
(XEN) 0000:06:00.2: modify bars cmd: 0 rom_only: 0
(XEN) 0000:06:00.2: write BAR2 val: 0xfffffff0 BAR2 address: 0xfffffff0
(XEN) 0000:06:00.2: write BAR2 val: 0xd0082000 BAR2 address: 0xd0082000
(XEN) 0000:06:00.2: write BAR2 val: 0xffffffff BAR3 address: 0xffffffffd0082000
(XEN) 0000:06:00.2: write BAR2 val: 0 BAR3 address: 0xd0082000
(XEN) 0000:06:00.2: modify bars cmd: 3 rom_only: 0
(XEN) 0000:06:00.2: modify bars cmd: 0 rom_only: 0
(XEN) 0000:06:00.2: modify bars cmd: 3 rom_only: 0
(XEN) 0000:06:00.2: modify bars cmd: 0 rom_only: 0
(XEN) 0000:06:00.2: modify bars cmd: 3 rom_only: 0
(XEN) 0000:06:00.2: modify bars cmd: 0 rom_only: 0
(XEN) 0000:06:00.2: modify bars cmd: 3 rom_only: 0
(XEN) PCI add device 0000:06:00.2
(XEN) 0000:06:00.3: modify bars cmd: 0 rom_only: 0
(XEN) 0000:06:00.3: write BAR0 val: 0xfffffff0 BAR0 address: 0xfffffff0
(XEN) 0000:06:00.3: write BAR0 val: 0xd0020000 BAR0 address: 0xd0020000
(XEN) 0000:06:00.3: modify bars cmd: 3 rom_only: 0
(XEN) 0000:06:00.3: modify bars cmd: 0 rom_only: 0
(XEN) 0000:06:00.3: write BAR1 val: 0xfffffff0 BAR1 address: 0xfffffff0
(XEN) 0000:06:00.3: write BAR1 val: 0xd0000000 BAR1 address: 0xd0000000
(XEN) 0000:06:00.3: modify bars cmd: 3 rom_only: 0
(XEN) 0000:06:00.3: modify bars cmd: 0 rom_only: 0
(XEN) 0000:06:00.3: write BAR2 val: 0xfffffff0 BAR2 address: 0xfffffff0
(XEN) 0000:06:00.3: write BAR2 val: 0xd0080000 BAR2 address: 0xd0080000
(XEN) 0000:06:00.3: write BAR2 val: 0xffffffff BAR3 address: 0xffffffffd0080000
(XEN) 0000:06:00.3: write BAR2 val: 0 BAR3 address: 0xd0080000
(XEN) 0000:06:00.3: modify bars cmd: 3 rom_only: 0
(XEN) 0000:06:00.3: modify bars cmd: 0 rom_only: 0
(XEN) 0000:06:00.3: modify bars cmd: 3 rom_only: 0
(XEN) 0000:06:00.3: modify bars cmd: 0 rom_only: 0
(XEN) 0000:06:00.3: modify bars cmd: 3 rom_only: 0
(XEN) 0000:06:00.3: modify bars cmd: 0 rom_only: 0
(XEN) 0000:06:00.3: modify bars cmd: 3 rom_only: 0
(XEN) PCI add device 0000:06:00.3
(XEN) arch/x86/hvm/svm/svm.c:1889:d0v0 RDMSR 0xc0010058 unimplemented
(XEN) arch/x86/hvm/svm/svm.c:1889:d0v0 RDMSR 0xc001029b unimplemented
(XEN) arch/x86/hvm/svm/svm.c:1889:d0v0 RDMSR 0xc001029a unimplemented
(XEN) common/grant_table.c:1909:d0v3 Expanding d0 grant table from 1 to 2 frames
(XEN) 0000:03:00.0: modify bars cmd: 5 rom_only: 0
(XEN) 0000:03:00.0: write BAR0 val: 0 BAR0 address: 0xfc00000000
(XEN) 0000:03:00.0: write BAR0 val: 0xa BAR1 address: 0xa00000000
(XEN) 0000:03:00.0: write BAR2 val: 0 BAR2 address: 0xfc00000000
(XEN) 0000:03:00.0: write BAR2 val: 0x9 BAR3 address: 0x900000000
(XEN) 0000:03:00.0: modify bars cmd: 7 rom_only: 0
(XEN) 0000:03:00.0: BAR0 ReBAR supported addr 0xa00000000 -> 0xa00000000 size 
0x10000000 -> 0x200000000
(XEN) 0000:03:00.0: detected BAR#0 size change (0x10000000 -> 0x200000000)
(XEN) 0000:03:00.0: BAR2 ReBAR supported addr 0x900000000 -> 0x900000000 size 
0x200000 -> 0x200000
(XEN) 0000:03:00.0: BAR5 ReBAR supported addr 0xd0600000 -> 0xd0600000 size 
0x100000 -> 0x100000
(XEN) d0v5 0000:03:00.0: ignored BAR 3 write while mapped
(XEN) d0v5 0000:03:00.0: ignored BAR 3 write while mapped
(XEN) d0v5 0000:03:00.0: ignored BAR 3 write while mapped
(XEN) d0v5 0000:03:00.0: ignored BAR 3 write while mapped
(XEN) d0v5 0000:03:00.0: ignored BAR 3 write while mapped
(XEN) d0v5 0000:03:00.0: ignored BAR 3 write while mapped
(XEN) d0v5 0000:03:00.0: ignored BAR 3 write while mapped
(XEN) d0v5 0000:03:00.0: ignored BAR 3 write while mapped
(XEN) d0v5 0000:03:00.0: ignored BAR 3 write while mapped
(XEN) d0v5 0000:03:00.0: ignored BAR 3 write while mapped
(XEN) d0v5 0000:03:00.0: ignored BAR 3 write while mapped
(XEN) d0v5 0000:03:00.0: ignored BAR 1 write while mapped
(XEN) d0v5 0000:03:00.0: ignored BAR 1 write while mapped
(XEN) d0v5 0000:03:00.0: ignored BAR 1 write while mapped
(XEN) d0v5 0000:03:00.0: ignored BAR 1 write while mapped
(XEN) d0v5 0000:03:00.0: ignored BAR 1 write while mapped
(XEN) d0v5 0000:03:00.0: ignored BAR 1 write while mapped
(XEN) d0v5 0000:03:00.0: ignored BAR 1 write while mapped
(XEN) d0v5 0000:03:00.0: ignored BAR 1 write while mapped
(XEN) d0v5 0000:03:00.0: ignored BAR 1 write while mapped
(XEN) d0v5 0000:03:00.0: ignored BAR 1 write while mapped
(XEN) d0v5 0000:03:00.0: ignored BAR 1 write while mapped

Reply via email to