This set of patches adds an automatic test of the vmstate via the scripts/vmstate-static-checker.py script. For this we need some reference files from an older version of QEMU. I chose to use QEMU 7.2 for the reference files since this is a long term support release that is still actively being maintained, so we certainly want to make sure that we don't break migration from that version to the latest one.
There are also some files available in tests/vmstate-static-checker-data/ which were used in the past to verify the functionality of the checker script. Move them to tests/data/vmstate-static-checker now and add an automated test for this task, too. Since the checker script can report false positives in certain cases, the tests are marked with the "skipFlakyTests" decorator, i.e. they are only run if the user set the QEMU_TEST_FLAKY_TESTS environment variable before starting the tests. v3: - Do not run the tests by default, only if QEMU_TEST_FLAKY_TESTS has been set - Add some hints what to do in case the test detects an error v2: - Dropped the patch that is already upstream - Don't remove the old dump files, rather test for the expected output of the checker script with them Thomas Huth (4): tests: Move the old vmstate-static-checker files to tests/data/ tests/data/vmstate-static-checker: Add dump files from QEMU 7.2.17 tests/functional: Test with scripts/vmstate-static-checker.py tests/functional/test_vmstate: Test whether the checker script works as expected MAINTAINERS | 3 +- .../aarch64/virt-7.2.json | 2571 +++++++++++++ .../vmstate-static-checker}/dump1.json | 0 .../vmstate-static-checker}/dump2.json | 0 .../vmstate-static-checker/m68k/virt-7.2.json | 2936 +++++++++++++++ .../ppc64/pseries-7.2.json | 1068 ++++++ .../s390x/s390-ccw-virtio-7.2.json | 475 +++ .../x86_64/pc-q35-7.2.json | 3297 +++++++++++++++++ tests/functional/meson.build | 13 +- tests/functional/test_vmstate.py | 103 + 10 files changed, 10464 insertions(+), 2 deletions(-) create mode 100644 tests/data/vmstate-static-checker/aarch64/virt-7.2.json rename tests/{vmstate-static-checker-data => data/vmstate-static-checker}/dump1.json (100%) rename tests/{vmstate-static-checker-data => data/vmstate-static-checker}/dump2.json (100%) create mode 100644 tests/data/vmstate-static-checker/m68k/virt-7.2.json create mode 100644 tests/data/vmstate-static-checker/ppc64/pseries-7.2.json create mode 100644 tests/data/vmstate-static-checker/s390x/s390-ccw-virtio-7.2.json create mode 100644 tests/data/vmstate-static-checker/x86_64/pc-q35-7.2.json create mode 100755 tests/functional/test_vmstate.py -- 2.49.0