I was looking at the test output of the CMake tests recently, and I noticed that they don't run XML validation even when it's not explicitly disabled. Looking at CMakeLists.txt, I found that each test program is run directly instead of through run_tests.py.

I don't think that's a very good idea. Sure, developers can run individual tests like that, but run-tests.py adds some common semantics that the build system shouldn't just skip. Like, for example, running XML validation on command output. It also handles test parallelization. I understand that the CMake project can run each test function from all the tests separately, but it's possible to do that through run-tests.py.

The alternative would probably be to install python-lxml and python-rnc2rng on the Windows test runners. I already did that for Linux runners (both autotools and cmake), because it is a bit more controlled than creating a virtual environment on the fly. However, I don't (want to?) know now to do that with vcpkg.

-- Brane

Reply via email to