Xen staging-4.6 crashes when booting on VMware Fusion 8.0.2 (with VT-x/EPT enabled), with 4 virtual CPUs:
Loading xen-4.6-amd64.gz... ok Loading vmlinuz-3.14.51-grsec-dock... ok Loading initrd.img-3.14.51-grsec-dock... ok (XEN) Xen version 4.6.1-pre (Debian 4.6.1~pre-1skyport1) ( eswi...@skyportsystems.com) (gcc (Debian 4.9.3-4) 4.9.3) debug=n Thu Nov 19 17:05:27 PST 2015 (XEN) Bootloader: SYSLINUX 4.05 20140113 (XEN) Command line: console=com1,vga com1=115200 no-bootscrub dom0_mem=2048M,max:2048M maxcpus=4 loglvl=all cpuinfo=1 (XEN) Video information: (XEN) VGA is text mode 80x25, font 8x16 (XEN) Disc information: (XEN) Found 1 MBR signatures (XEN) Found 1 EDD information structures (XEN) Xen-e820 RAM map: (XEN) 0000000000000000 - 000000000009f800 (usable) (XEN) 000000000009f800 - 00000000000a0000 (reserved) (XEN) 00000000000dc000 - 0000000000100000 (reserved) (XEN) 0000000000100000 - 00000000bfef0000 (usable) (XEN) 00000000bfef0000 - 00000000bfeff000 (ACPI data) (XEN) 00000000bfeff000 - 00000000bff00000 (ACPI NVS) (XEN) 00000000bff00000 - 00000000c0000000 (usable) (XEN) 00000000f0000000 - 00000000f8000000 (reserved) (XEN) 00000000fec00000 - 00000000fec10000 (reserved) (XEN) 00000000fee00000 - 00000000fee01000 (reserved) (XEN) 00000000fffe0000 - 0000000100000000 (reserved) (XEN) 0000000100000000 - 00000001c0000000 (usable) (XEN) ACPI: RSDP 000F6A10, 0024 (r2 PTLTD ) (XEN) ACPI: XSDT BFEF030B, 0054 (r1 INTEL 440BX 6040000 VMW 1324272) (XEN) ACPI: FACP BFEFEE73, 00F4 (r4 INTEL 440BX 6040000 PTL F4240) (XEN) ACPI: DSDT BFEF05B1, E8C2 (r1 PTLTD Custom 6040000 MSFT 3000001) (XEN) ACPI: FACS BFEFFFC0, 0040 (XEN) ACPI: BOOT BFEF0589, 0028 (r1 PTLTD $SBFTBL$ 6040000 LTP 1) (XEN) ACPI: APIC BFEF050F, 007A (r1 PTLTD APIC 6040000 LTP 0) (XEN) ACPI: MCFG BFEF04D3, 003C (r1 PTLTD $PCITBL$ 6040000 LTP 1) (XEN) ACPI: SRAT BFEF03C3, 0110 (r2 VMWARE MEMPLUG 6040000 VMW 1) (XEN) ACPI: WAET BFEF039B, 0028 (r1 VMWARE VMW WAET 6040000 VMW 1) (XEN) System RAM: 6143MB (6291004kB) (XEN) SRAT: PXM 0 -> APIC 00 -> Node 0 (XEN) SRAT: PXM 0 -> APIC 02 -> Node 0 (XEN) SRAT: PXM 0 -> APIC 04 -> Node 0 (XEN) SRAT: PXM 0 -> APIC 06 -> Node 0 (XEN) SRAT: Node 0 PXM 0 0-a0000 (XEN) SRAT: Node 0 PXM 0 100000-10000000 (XEN) SRAT: Node 0 PXM 0 10000000-c0000000 (XEN) SRAT: Node 0 PXM 0 100000000-1c0000000 (XEN) NUMA: Allocated memnodemap from 1bd8fc000 - 1bd8fe000 (XEN) NUMA: Using 8 for the hash shift. (XEN) Domain heap initialised (XEN) found SMP MP-table at 000f6a80 (XEN) DMI present. (XEN) Using APIC driver default (XEN) ACPI: PM-Timer IO Port: 0x1008 (XEN) ACPI: SLEEP INFO: pm1x_cnt[1:1004,1:0], pm1x_evt[1:1000,1:0] (XEN) ACPI: wakeup_vec[bfefffcc], vec_size[20] (XEN) ACPI: Local APIC address 0xfee00000 (XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) (XEN) Processor #0 6:6 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled) (XEN) Processor #2 6:6 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled) (XEN) Processor #4 6:6 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled) (XEN) Processor #6 6:6 APIC version 21 (XEN) ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) (XEN) ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0]) (XEN) IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-23 (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge) (XEN) ACPI: IRQ0 used by override. (XEN) ACPI: IRQ2 used by override. (XEN) Enabling APIC mode: Flat. Using 1 I/O APICs (XEN) ERST table was not found (XEN) Using ACPI (MADT) for SMP configuration information (XEN) SMP: Allowing 4 CPUs (0 hotplug CPUs) (XEN) IRQ limits: 24 GSI, 760 MSI/MSI-X (XEN) Not enabling x2APIC: depends on iommu_supports_eim. (XEN) CPU: Physical Processor ID: 0 (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K (XEN) CPU: L2 cache: 256K (XEN) CPU: L3 cache: 6144K (XEN) xstate_init: using cntxt_size: 0x340 and states: 0x7 (XEN) CPU0: No MCE banks present. Machine check support disabled (XEN) Using scheduler: SMP Credit Scheduler (credit) (XEN) Initializing CPU#0 (XEN) Detected 2592.811 MHz processor. (XEN) Initing memory sharing. (XEN) alt table ffff82d0802be010 -> ffff82d0802bf384 (XEN) PCI: MCFG configuration 0: base f0000000 segment 0000 buses 00 - 7f (XEN) PCI: MCFG area at f0000000 reserved in E820 (XEN) PCI: Using MCFG for segment 0000 bus 00-7f (XEN) I/O virtualisation disabled (XEN) CPU0: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01 (XEN) ENABLING IO-APIC IRQs (XEN) -> Using new ACK method (XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1 (XEN) Platform timer is 3.579MHz ACPI PM Timer (XEN) Allocated console ring of 32 KiB. (XEN) mwait-idle: MWAIT substates: 0x10 (XEN) mwait-idle: v0.4 model 0x46 (XEN) mwait-idle: lapic_timer_reliable_states 0xffffffff (XEN) VMX: Supported advanced features: (XEN) - APIC TPR shadow (XEN) - Extended Page Tables (EPT) (XEN) - Virtual-Processor Identifiers (VPID) (XEN) - Virtual NMI (XEN) - MSR direct-access bitmap (XEN) - Unrestricted Guest (XEN) HVM: ASIDs enabled. (XEN) HVM: VMX enabled (XEN) HVM: Hardware Assisted Paging (HAP) not detected (XEN) HVM: PVH mode not supported on this platform (XEN) CPU 0 APIC 0 -> Node 0 (XEN) CPU 1 APIC 2 -> Node 0 (XEN) Booting processor 1/2 eip 8f000 (XEN) Initializing CPU#1 (XEN) CPU: Physical Processor ID: 2 (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K (XEN) CPU: L2 cache: 256K (XEN) CPU: L3 cache: 6144K (XEN) CPU1: No MCE banks present. Machine check support disabled (XEN) CPU1: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01 (XEN) CPU 2 APIC 4 -> Node 0 (XEN) Booting processor 2/4 eip 8f000 (XEN) Initializing CPU#2 (XEN) CPU: Physical Processor ID: 4 (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K (XEN) CPU: L2 cache: 256K (XEN) CPU: L3 cache: 6144K (XEN) CPU2: No MCE banks present. Machine check support disabled (XEN) CPU2: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01 (XEN) CPU 3 APIC 6 -> Node 0 (XEN) Booting processor 3/6 eip 8f000 (XEN) Initializing CPU#3 (XEN) CPU: Physical Processor ID: 6 (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K (XEN) CPU: L2 cache: 256K (XEN) CPU: L3 cache: 6144K (XEN) CPU3: No MCE banks present. Machine check support disabled (XEN) CPU3: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01 (XEN) ----[ Xen-4.6.1-pre x86_64 debug=n Not tainted ]---- (XEN) CPU: 3 (XEN) RIP: e008:[<ffff82d08018302f>] set_cpu_sibling_map+0x3f/0x330 (XEN) RFLAGS: 0000000000010006 CONTEXT: hypervisor (XEN) rax: 0000000000000001 rbx: 0000000000000000 rcx: 000000313d5b4080 (XEN) rdx: 0000000000000006 rsi: 0000000000000000 rdi: 0000000000000003 (XEN) rbp: 0000000000000300 rsp: ffff8301bd87fe90 r8: ffff8301bd878000 (XEN) r9: 000000313d5b4080 r10: 0000000000000001 r11: 0000000000000001 (XEN) r12: ffff82d0802fd500 r13: 0000000000000000 r14: 0000000000000000 (XEN) r15: 0000000000000003 cr0: 000000008005003b cr4: 00000000001526a0 (XEN) cr3: 00000000bfc75000 cr2: 0000000000000001 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008 (XEN) Xen stack trace from rsp=ffff8301bd87fe90: (XEN) 00000003802fd800 0000000000000018 0000000000000000 0000010000000000 (XEN) ffff82d0802fd800 0000000000000000 00000000000000c8 0000000000000003 (XEN) 0000000000000000 0000000000000000 0000000000000000 ffff82d0801834dc (XEN) 0000000000000000 0000000000000001 0000000000000000 0000000000000000 (XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) 0000000000000000 0000000000000000 0000000000000003 ffff8300bfafc000 (XEN) 000000313d5b4080 0000000000000000 (XEN) Xen call trace: (XEN) [<ffff82d08018302f>] set_cpu_sibling_map+0x3f/0x330 (XEN) [<ffff82d0801834dc>] start_secondary+0x1bc/0x250 (XEN) (XEN) Pagetable walk from 0000000000000001: (XEN) L4[0x000] = 00000001bd8f0063 ffffffffffffffff (XEN) L3[0x000] = 00000001bd8ef063 ffffffffffffffff (XEN) L2[0x000] = 00000001bd8ee063 ffffffffffffffff (XEN) L1[0x000] = 0000000000000000 ffffffffffffffff (XEN) (XEN) **************************************** (XEN) Panic on CPU 3: (XEN) FATAL PAGE FAULT (XEN) [error_code=0002] (XEN) Faulting linear address: 0000000000000001 (XEN) **************************************** (XEN) (XEN) Reboot in five seconds... set_cpu_sibling_map+0x3f is the second cpumask_set_cpu() call in set_cpu_sibling_map(): http://xenbits.xen.org/gitweb/?p=xen.git;a=blob;f=xen/arch/x86/smpboot.c;h=094699286f4f6962942024ec8b2b24c7b7996cc0;hb=78833c04250416f1870c458309d3ac0e5cf915fd#l261 The crash does not occur if I set maxcpus=3 on the Xen command line: Loading xen-4.6-amd64.gz... ok Loading vmlinuz-3.14.51-grsec-dock... ok Loading initrd.img-3.14.51-grsec-dock... ok (XEN) Xen version 4.6.1-pre (Debian 4.6.1~pre-1skyport1) ( eswi...@skyportsystems.com) (gcc (Debian 4.9.3-4) 4.9.3) debug=n Thu Nov 19 17:05:27 PST 2015 (XEN) Bootloader: SYSLINUX 4.05 20140113 (XEN) Command line: console=com1,vga com1=115200 no-bootscrub dom0_mem=2048M,max:2048M maxcpus=3 loglvl=all cpuinfo=1 (XEN) Video information: (XEN) VGA is text mode 80x25, font 8x16 (XEN) Disc information: (XEN) Found 1 MBR signatures (XEN) Found 1 EDD information structures (XEN) Xen-e820 RAM map: (XEN) 0000000000000000 - 000000000009f800 (usable) (XEN) 000000000009f800 - 00000000000a0000 (reserved) (XEN) 00000000000dc000 - 0000000000100000 (reserved) (XEN) 0000000000100000 - 00000000bfef0000 (usable) (XEN) 00000000bfef0000 - 00000000bfeff000 (ACPI data) (XEN) 00000000bfeff000 - 00000000bff00000 (ACPI NVS) (XEN) 00000000bff00000 - 00000000c0000000 (usable) (XEN) 00000000f0000000 - 00000000f8000000 (reserved) (XEN) 00000000fec00000 - 00000000fec10000 (reserved) (XEN) 00000000fee00000 - 00000000fee01000 (reserved) (XEN) 00000000fffe0000 - 0000000100000000 (reserved) (XEN) 0000000100000000 - 00000001c0000000 (usable) (XEN) ACPI: RSDP 000F6A10, 0024 (r2 PTLTD ) (XEN) ACPI: XSDT BFEF030B, 0054 (r1 INTEL 440BX 6040000 VMW 1324272) (XEN) ACPI: FACP BFEFEE73, 00F4 (r4 INTEL 440BX 6040000 PTL F4240) (XEN) ACPI: DSDT BFEF05B1, E8C2 (r1 PTLTD Custom 6040000 MSFT 3000001) (XEN) ACPI: FACS BFEFFFC0, 0040 (XEN) ACPI: BOOT BFEF0589, 0028 (r1 PTLTD $SBFTBL$ 6040000 LTP 1) (XEN) ACPI: APIC BFEF050F, 007A (r1 PTLTD APIC 6040000 LTP 0) (XEN) ACPI: MCFG BFEF04D3, 003C (r1 PTLTD $PCITBL$ 6040000 LTP 1) (XEN) ACPI: SRAT BFEF03C3, 0110 (r2 VMWARE MEMPLUG 6040000 VMW 1) (XEN) ACPI: WAET BFEF039B, 0028 (r1 VMWARE VMW WAET 6040000 VMW 1) (XEN) System RAM: 6143MB (6291004kB) (XEN) SRAT: PXM 0 -> APIC 00 -> Node 0 (XEN) SRAT: PXM 0 -> APIC 02 -> Node 0 (XEN) SRAT: PXM 0 -> APIC 04 -> Node 0 (XEN) SRAT: PXM 0 -> APIC 06 -> Node 0 (XEN) SRAT: Node 0 PXM 0 0-a0000 (XEN) SRAT: Node 0 PXM 0 100000-10000000 (XEN) SRAT: Node 0 PXM 0 10000000-c0000000 (XEN) SRAT: Node 0 PXM 0 100000000-1c0000000 (XEN) NUMA: Allocated memnodemap from 1bd8fc000 - 1bd8fe000 (XEN) NUMA: Using 8 for the hash shift. (XEN) Domain heap initialised (XEN) found SMP MP-table at 000f6a80 (XEN) DMI present. (XEN) Using APIC driver default (XEN) ACPI: PM-Timer IO Port: 0x1008 (XEN) ACPI: SLEEP INFO: pm1x_cnt[1:1004,1:0], pm1x_evt[1:1000,1:0] (XEN) ACPI: wakeup_vec[bfefffcc], vec_size[20] (XEN) ACPI: Local APIC address 0xfee00000 (XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) (XEN) Processor #0 6:6 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled) (XEN) Processor #2 6:6 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled) (XEN) Processor #4 6:6 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled) (XEN) Processor #6 6:6 APIC version 21 (XEN) ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) (XEN) ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0]) (XEN) IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-23 (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge) (XEN) ACPI: IRQ0 used by override. (XEN) ACPI: IRQ2 used by override. (XEN) Enabling APIC mode: Flat. Using 1 I/O APICs (XEN) ERST table was not found (XEN) Using ACPI (MADT) for SMP configuration information (XEN) SMP: Allowing 3 CPUs (0 hotplug CPUs) (XEN) IRQ limits: 24 GSI, 568 MSI/MSI-X (XEN) Not enabling x2APIC: depends on iommu_supports_eim. (XEN) CPU: Physical Processor ID: 0 (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K (XEN) CPU: L2 cache: 256K (XEN) CPU: L3 cache: 6144K (XEN) xstate_init: using cntxt_size: 0x340 and states: 0x7 (XEN) CPU0: No MCE banks present. Machine check support disabled (XEN) Using scheduler: SMP Credit Scheduler (credit) (XEN) Initializing CPU#0 (XEN) Detected 2592.652 MHz processor. (XEN) Initing memory sharing. (XEN) alt table ffff82d0802be010 -> ffff82d0802bf384 (XEN) PCI: MCFG configuration 0: base f0000000 segment 0000 buses 00 - 7f (XEN) PCI: MCFG area at f0000000 reserved in E820 (XEN) PCI: Using MCFG for segment 0000 bus 00-7f (XEN) I/O virtualisation disabled (XEN) CPU0: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01 (XEN) ENABLING IO-APIC IRQs (XEN) -> Using new ACK method (XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1 (XEN) Platform timer is 3.579MHz ACPI PM Timer (XEN) Allocated console ring of 32 KiB. (XEN) mwait-idle: MWAIT substates: 0x10 (XEN) mwait-idle: v0.4 model 0x46 (XEN) mwait-idle: lapic_timer_reliable_states 0xffffffff (XEN) VMX: Supported advanced features: (XEN) - APIC TPR shadow (XEN) - Extended Page Tables (EPT) (XEN) - Virtual-Processor Identifiers (VPID) (XEN) - Virtual NMI (XEN) - MSR direct-access bitmap (XEN) - Unrestricted Guest (XEN) HVM: ASIDs enabled. (XEN) HVM: VMX enabled (XEN) HVM: Hardware Assisted Paging (HAP) not detected (XEN) HVM: PVH mode not supported on this platform (XEN) CPU 0 APIC 0 -> Node 0 (XEN) CPU 1 APIC 2 -> Node 0 (XEN) Booting processor 1/2 eip 8f000 (XEN) Initializing CPU#1 (XEN) CPU: Physical Processor ID: 2 (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K (XEN) CPU: L2 cache: 256K (XEN) CPU: L3 cache: 6144K (XEN) CPU1: No MCE banks present. Machine check support disabled (XEN) CPU1: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01 (XEN) CPU 2 APIC 4 -> Node 0 (XEN) Booting processor 2/4 eip 8f000 (XEN) Initializing CPU#2 (XEN) CPU: Physical Processor ID: 4 (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K (XEN) CPU: L2 cache: 256K (XEN) CPU: L3 cache: 6144K (XEN) CPU2: No MCE banks present. Machine check support disabled (XEN) CPU2: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01 (XEN) Brought up 3 CPUs (XEN) ACPI sleep modes: S3 (XEN) VPMU: disabled (XEN) Dom0 has maximum 408 PIRQs (XEN) NX (Execute Disable) protection active (XEN) *** LOADING DOMAIN 0 *** (XEN) Xen kernel: 64-bit, lsb, compat32 (XEN) Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x3000000 (XEN) PHYSICAL MEMORY ARRANGEMENT: (XEN) Dom0 alloc.: 00000001b4000000->00000001b8000000 (504532 pages to be allocated) (XEN) Init. ramdisk: 00000001bf2d4000->00000001bffff800 (XEN) VIRTUAL MEMORY ARRANGEMENT: (XEN) Loaded kernel: ffffffff81000000->ffffffff83000000 (XEN) Init. ramdisk: ffffffff83000000->ffffffff83d2b800 (XEN) Phys-Mach map: ffffffff83d2c000->ffffffff8412c000 (XEN) Start info: ffffffff8412c000->ffffffff8412c4b4 (XEN) Page tables: ffffffff8412d000->ffffffff84152000 (XEN) Boot stack: ffffffff84152000->ffffffff84153000 (XEN) TOTAL: ffffffff80000000->ffffffff84400000 (XEN) ENTRY ADDRESS: ffffffff81f991f0 (XEN) Dom0 has maximum 3 VCPUs (XEN) Std. Loglevel: All (XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings) (XEN) Xen is relinquishing VGA console. (XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen) (XEN) Freed 316kB init memory. mapping kernel into physical memory about to get started... Actually I tried all numbers of CPUs between 2 and 8, and the crash occurs only with 4 or 6 CPUs. Xen boots fine with 2, 3, 5, 7 or 8 CPUs. Same results with the official 4.6.0 release. Xen 4.5.1 boots fine on Fusion with any number of CPUs. Any clues would be appreciated! --Ed
_______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
