06.12.2019 22:43, Cleber Rosa wrote: > On Tue, Nov 26, 2019 at 06:48:45PM +0300, Vladimir Sementsov-Ogievskiy wrote: >> Hi all! >> >> Here is simple benchmarking utility, to generate performance >> comparison tables, like the following: >> >> ---------- ------------- ------------- ------------- >> backup-1 backup-2 mirror >> ssd -> ssd 0.43 +- 0.00 4.48 +- 0.06 4.38 +- 0.02 >> ssd -> hdd 10.60 +- 0.08 10.69 +- 0.18 10.57 +- 0.05 >> ssd -> nbd 33.81 +- 0.37 10.67 +- 0.17 10.07 +- 0.07 >> ---------- ------------- ------------- ------------- >> >> This is a v2, as v1 was inside >> "[RFC 00/24] backup performance: block_status + async" >> >> I'll use this benchmark in other series, hope someone >> will like it. >> >> Vladimir Sementsov-Ogievskiy (3): >> python: add simplebench.py >> python: add qemu/bench_block_job.py >> python: add example usage of simplebench >> >> python/bench-example.py | 80 +++++++++++++++++++++ >> python/qemu/bench_block_job.py | 115 +++++++++++++++++++++++++++++ >> python/simplebench.py | 128 +++++++++++++++++++++++++++++++++ >> 3 files changed, 323 insertions(+) >> create mode 100644 python/bench-example.py >> create mode 100755 python/qemu/bench_block_job.py >> create mode 100644 python/simplebench.py >> >> -- >> 2.18.0 >> > > Hi Vladimir, > > This looks interesting. > > Do you think the execution of "test cases" in an "environment" are a > generic enough concept that could be reused (or reuse other system)?
that was my goal: to make something generic enough, but simple. Yes, it can be reused for anything > My point is that it'd be nice to do the same thing say for the > acceptance tests, or any tests for that matter. For instance, for > known parameters, we could record what's the time difference between > booting a guest with q35 or pc machine types and virtio-block or > virtio-scsi devices. > > BTW, This reminded me of a IOzone[1] test runner / results analyzer: > > > https://github.com/avocado-framework-tests/avocado-misc-tests/blob/master/io/disk/iozone.py > > I'm also cc'ing Lukáš Doktor, who has actively worked in something > similar. > > Cheers, > - Cleber. > -- Best regards, Vladimir
