This patch series creates a mandatory venv during configure time and uses it to install meson.
The eventual point of this is to ensure that the Python used to run meson is the same Python used to run Sphinx, tests, and any build-time scripting we have. As it stands, meson and sphinx (and their extensions) may run in a different Python environment than the one configured and chosen by the user at configure/build time. My goals for this series and future work are: - Unconditionally create a venv to be used for both building and testing at configure time - The python interpreter used by this venv is unconditionally the one specified by configure - *all* python scripts in qemu.git executed as part of the build system, tests, or CI are *always* executed in the context of this venv. - It is possible to build and test fully offline with sufficient preparation by installing appropriate system packages. - Missing depdencies, when possible, are fetched and installed automatically to make developer environments "just work". - Minimize cost during configure time whenever possible. This series is in RFC state; some notable things: - So far, only meson is included in this setup. - There's a ton of debugging prints everywhere. It's extremely chatty right now. - Sphinx and qemu.qmp are not yet included in this venv. (qemu.qmp isn't able to be removed from the tree yet.) - Testing isn't yet *fully* switched over. - There is no online functionality yet, this series is *100% offline* - it's the harder option, so I tackled it first. Some known bugs as of now: - venv-in-venv setups are not yet handled. - python3.7 setups without setuptools/pip in the host environment may be unable to generate script file shims; a workaround is in development but wasn't ready today. I decided to exclude it. The good news: - Works for Python 3.7 and up, on Fedora, OpenSuSE, Red Hat, CentOS, Alpine, Debian, Ubuntu, NetBSD, OpenBSD, and hopefully everywhere - Startup cost is only milliseconds on the fast path - No new dependencies (...for most platforms; the asterisk is Debian.) - No new configure flags (...yet.) John Snow (3): python: add mkvenv.py tests: add python3-venv dependency configure: install meson to a python virtual environment configure | 155 ++++-- .gitlab-ci.d/buildtest-template.yml | 2 +- python/scripts/mkvenv.py | 445 ++++++++++++++++++ .../dockerfiles/debian-all-test-cross.docker | 3 +- .../dockerfiles/debian-hexagon-cross.docker | 3 +- .../dockerfiles/debian-riscv64-cross.docker | 3 +- .../dockerfiles/debian-tricore-cross.docker | 3 +- 7 files changed, 561 insertions(+), 53 deletions(-) create mode 100644 python/scripts/mkvenv.py -- 2.39.2
