It can already be built with chroots and AFAIK the armv6/7 VMs run on a aarch64 kernel.
In fact, chroots already work with mismatching architectures thanks to qemu-user. Chroots also do not solve and cannot solve the main issue we want cross-compilation for, which is the linker not having enough address space.
