Hello Andreas, lists, On 30/11/2024 19:28, Andreas Tille wrote: ...
Additionally, I wonder if an automated test suite for the installer might be helpful.
...
There is already some fully automated testing in place.The d-i installer is used at least in 2 different modes: in the netinst image and in the live images. Both modes are used in automated openQA tests [1], which performs a few tests, emulating what a user would do (i.e. no preseeding): * Boot the medium and continue until the first screen of the installer for each entry in the GRUB/isolinux menu
* Select each language in d-i and continue until the first screen* Install each available desktop from tasksel (netinst) + boot into that image
* Install each desktop image (live) + boot into that imageThe installation steps are for a typical desktop environment, assuming an empty hard disk.
The existing test can select between an unencrypted and encrypted scenario.The netinst tests are generated for 'testing' and run 3x per day. All live images for 'sid' are tested daily, for 'testing' 2x/week and 'stable' and 'oldstable' monthly.
The d-i is a very complex product, there are many possible ways (code paths) to traverse the software until the end. Surely we can't reach 100% code coverage easily.
Andreas, what do you have in mind regarding the tests? What scenarios would be needed/required?
With kind regards, Roland Clobus [1] https://openqa.debian.net/
OpenPGP_signature.asc
Description: OpenPGP digital signature
