Hi Penny,
On 13/01/2023 05:28, Penny Zheng wrote:
CAUTION: This message has originated from an External Source. Please use proper
judgment and caution when opening attachments, clicking links, or responding to
this email.
The Armv8-R architecture profile was designed to support use cases
that have a high sensitivity to deterministic execution. (e.g.
Fuel Injection, Brake control, Drive trains, Motor control etc)
Arm announced Armv8-R in 2013, it is the latest generation Arm
architecture targeted at the Real-time profile. It introduces
virtualization at the highest security level while retaining the
Protected Memory System Architecture (PMSA) based on a Memory
Protection Unit (MPU). In 2020, Arm announced Cortex-R82,
which is the first Arm 64-bit Cortex-R processor based on Armv8-R64.
The latest Armv8-R64 document can be found [1]. And the features of
Armv8-R64 architecture:
- An exception model that is compatible with the Armv8-A model
- Virtualization with support for guest operating systems
- PMSA virtualization using MPUs In EL2.
- Adds support for the 64-bit A64 instruction set.
- Supports up to 48-bit physical addressing.
- Supports three Exception Levels (ELs)
- Secure EL2 - The Highest Privilege
- Secure EL1 - RichOS (MMU) or RTOS (MPU)
- Secure EL0 - Application Workloads
- Supports only a single Security state - Secure.
- MPU in EL1 & EL2 is configurable, MMU in EL1 is configurable.
These patch series are implementing the Armv8-R64 MPU support
for Xen, which are based on the discussion of
"Proposal for Porting Xen to Armv8-R64 - DraftC" [2].
We will implement the Armv8-R64 and MPU support in three stages:
1. Boot Xen itself to idle thread, do not create any guests on it.
2. Support to boot MPU and MMU domains on Armv8-R64 Xen.
3. SMP and other advanced features of Xen support on Armv8-R64.
As we have not implemented guest support in part#1 series of MPU
support, Xen can not create any guest in boot time. So in this
patch serie, we provide an extra DNM-commit in the last for users
to test Xen boot to idle on MPU system.
We will split these patches to several parts, this series is the
part#1, v1 is in [3], the full PoC can be found in [4]. More software for
Armv8-R64 can be found in [5];
[1] https://developer.arm.com/documentation/ddi0600/latest
[2] https://lists.xenproject.org/archives/html/xen-devel/2022-05/msg00643.html
[3] https://lists.xenproject.org/archives/html/xen-devel/2022-11/msg00289.html
[4] https://gitlab.com/xen-project/people/weic/xen/-/tree/integration/mpu_v2
[5] https://armv8r64-refstack.docs.arm.com/en/v5.0/
Penny Zheng (28):
xen/mpu: build up start-of-day Xen MPU memory region map
xen/mpu: introduce helpers for MPU enablement
xen/mpu: introduce unified function setup_early_uart to map early UART
xen/arm64: head: Jump to the runtime mapping in enable_mm()
xen/arm: introduce setup_mm_mappings
xen/mpu: plump virt/maddr/mfn convertion in MPU system
xen/mpu: introduce helper access_protection_region
xen/mpu: populate a new region in Xen MPU mapping table
xen/mpu: plump early_fdt_map in MPU systems
xen/arm: move MMU-specific setup_mm to setup_mmu.c
xen/mpu: implement MPU version of setup_mm in setup_mpu.c
xen/mpu: initialize frametable in MPU system
xen/mpu: introduce "mpu,xxx-memory-section"
xen/mpu: map MPU guest memory section before static memory
initialization
xen/mpu: destroy an existing entry in Xen MPU memory mapping table
xen/mpu: map device memory resource in MPU system
xen/mpu: map boot module section in MPU system
xen/mpu: introduce mpu_memory_section_contains for address range check
xen/mpu: disable VMAP sub-system for MPU systems
xen/mpu: disable FIXMAP in MPU system
xen/mpu: implement MPU version of ioremap_xxx
xen/mpu: free init memory in MPU system
xen/mpu: destroy boot modules and early FDT mapping in MPU system
xen/mpu: Use secure hypervisor timer for AArch64v8R
xen/mpu: move MMU specific P2M code to p2m_mmu.c
xen/mpu: implement setup_virt_paging for MPU system
xen/mpu: re-order xen_mpumap in arch_init_finialize
xen/mpu: add Kconfig option to enable Armv8-R AArch64 support
Wei Chen (13):
xen/arm: remove xen_phys_start and xenheap_phys_end from config.h
xen/arm: make ARM_EFI selectable for Arm64
xen/arm: adjust Xen TLB helpers for Armv8-R64 PMSA
xen/arm: add an option to define Xen start address for Armv8-R
xen/arm64: prepare for moving MMU related code from head.S
xen/arm64: move MMU related code from head.S to head_mmu.S
xen/arm64: add .text.idmap for Xen identity map sections
xen/arm: use PA == VA for EARLY_UART_VIRTUAL_ADDRESS on Armv-8R
xen/arm: decouple copy_from_paddr with FIXMAP
xen/arm: split MMU and MPU config files from config.h
xen/arm: move MMU-specific memory management code to mm_mmu.c/mm_mmu.h
xen/arm: check mapping status and attributes for MPU copy_from_paddr
xen/mpu: make Xen boot to idle on MPU systems(DNM)
xen/arch/arm/Kconfig | 44 +-
xen/arch/arm/Makefile | 17 +-
xen/arch/arm/arm64/Makefile | 5 +
xen/arch/arm/arm64/head.S | 466 +----
xen/arch/arm/arm64/head_mmu.S | 399 ++++
xen/arch/arm/arm64/head_mpu.S | 394 ++++
xen/arch/arm/bootfdt.c | 13 +-
xen/arch/arm/domain_build.c | 4 +
xen/arch/arm/include/asm/alternative.h | 15 +
xen/arch/arm/include/asm/arm64/flushtlb.h | 25 +
xen/arch/arm/include/asm/arm64/macros.h | 51 +
xen/arch/arm/include/asm/arm64/mpu.h | 174 ++
xen/arch/arm/include/asm/arm64/sysregs.h | 77 +
xen/arch/arm/include/asm/config.h | 105 +-
xen/arch/arm/include/asm/config_mmu.h | 112 +
xen/arch/arm/include/asm/config_mpu.h | 25 +
xen/arch/arm/include/asm/cpregs.h | 4 +-
xen/arch/arm/include/asm/cpuerrata.h | 12 +
xen/arch/arm/include/asm/cpufeature.h | 7 +
xen/arch/arm/include/asm/early_printk.h | 13 +
xen/arch/arm/include/asm/fixmap.h | 28 +-
xen/arch/arm/include/asm/flushtlb.h | 22 +
xen/arch/arm/include/asm/mm.h | 78 +-
xen/arch/arm/include/asm/mm_mmu.h | 77 +
xen/arch/arm/include/asm/mm_mpu.h | 54 +
xen/arch/arm/include/asm/p2m.h | 27 +-
xen/arch/arm/include/asm/p2m_mmu.h | 28 +
xen/arch/arm/include/asm/processor.h | 13 +
xen/arch/arm/include/asm/setup.h | 39 +
xen/arch/arm/kernel.c | 31 +-
xen/arch/arm/mm.c | 1340 +-----------
xen/arch/arm/mm_mmu.c | 1376 +++++++++++++
xen/arch/arm/mm_mpu.c | 1056 ++++++++++
xen/arch/arm/p2m.c | 2282 +--------------------
xen/arch/arm/p2m_mmu.c | 2257 ++++++++++++++++++++
xen/arch/arm/p2m_mpu.c | 274 +++
xen/arch/arm/platforms/Kconfig | 16 +-
xen/arch/arm/setup.c | 394 +---
xen/arch/arm/setup_mmu.c | 391 ++++
xen/arch/arm/setup_mpu.c | 208 ++
xen/arch/arm/time.c | 14 +-
xen/arch/arm/traps.c | 2 +
xen/arch/arm/xen.lds.S | 10 +-
xen/arch/x86/Kconfig | 1 +
xen/common/Kconfig | 6 +
xen/common/Makefile | 2 +-
xen/include/xen/vmap.h | 93 +-
47 files changed, 7500 insertions(+), 4581 deletions(-)
create mode 100644 xen/arch/arm/arm64/head_mmu.S
create mode 100644 xen/arch/arm/arm64/head_mpu.S
create mode 100644 xen/arch/arm/include/asm/arm64/mpu.h
create mode 100644 xen/arch/arm/include/asm/config_mmu.h
create mode 100644 xen/arch/arm/include/asm/config_mpu.h
create mode 100644 xen/arch/arm/include/asm/mm_mmu.h
create mode 100644 xen/arch/arm/include/asm/mm_mpu.h
create mode 100644 xen/arch/arm/include/asm/p2m_mmu.h
create mode 100644 xen/arch/arm/mm_mmu.c
create mode 100644 xen/arch/arm/mm_mpu.c
create mode 100644 xen/arch/arm/p2m_mmu.c
create mode 100644 xen/arch/arm/p2m_mpu.c
create mode 100644 xen/arch/arm/setup_mmu.c
create mode 100644 xen/arch/arm/setup_mpu.c
--
2.25.1
I applied this serie and there were some compilation issues :-
1. drivers/passthrough/arm/smmu.c:1240:29: error: ‘P2M_ROOT_LEVEL’
undeclared (first use in this function)
1240 | reg |= (2 - P2M_ROOT_LEVEL) << TTBCR_SL0_SHIFT;
2. drivers/passthrough/arm/smmu-v3.c:1211:24: error: ‘P2M_ROOT_LEVEL’
undeclared (first use in this function)
1211 | vtcr->sl = 2 - P2M_ROOT_LEVEL;
For the above two issues, I have disabled SMMU.
3. /scratch/ayankuma/xen_v8r_64/xen/arch/arm/arm64/head.S:470: undefined
reference to `init_ttbr'
You might need to wrap with some #ifdef .
Can you provide me the dts and the config file with which you have tested ?
I see that the console got stuck at this line.
"(XEN) Command line: console=dtuart dtuart=serial0"
Looking into setup_static_mappings(),
for ( uint8_t i = MSINFO_GUEST; i < MSINFO_MAX; i++ )
{
#ifdef CONFIG_EARLY_PRINTK
if ( i == MSINFO_DEVICE )
/*
* Destroy early UART mapping before mapping device memory
section.
* WARNING：console will be inaccessible temporarily.
*/
destroy_xen_mappings(CONFIG_EARLY_UART_BASE_ADDRESS,
CONFIG_EARLY_UART_BASE_ADDRESS +
EARLY_UART_SIZE);
#endif
map_mpu_memory_section_on_boot(i, mpu_section_mattr[i]);
<<<<----- Is this expected to map "mpu,device-memory-section" ?
}
- Ayan
