Re: [PATCH] tests: improve performance of device-introspect-test

2020-07-14 Thread Markus Armbruster
Daniel P. Berrangé writes: > On Fri, Jul 10, 2020 at 10:03:56PM +0200, Markus Armbruster wrote: >> Daniel P. Berrangé writes: >> >> > Total execution time with "-m slow" and x86_64 QEMU, drops from 3 >> > minutes 15 seconds, down to 54 seconds. >> > >> > Individual tests drop from 17-20 seconds

Re: [PATCH] tests: improve performance of device-introspect-test

2020-07-13 Thread Daniel P . Berrangé
On Fri, Jul 10, 2020 at 10:03:56PM +0200, Markus Armbruster wrote: > Daniel P. Berrangé writes: > > > Total execution time with "-m slow" and x86_64 QEMU, drops from 3 > > minutes 15 seconds, down to 54 seconds. > > > > Individual tests drop from 17-20 seconds, down to 3-4 seconds. > > Nice! >

Re: [PATCH] tests: improve performance of device-introspect-test

2020-07-12 Thread Thomas Huth
On 10/07/2020 22.03, Markus Armbruster wrote: [...] > With -m slow, we test 2 * #machines * #devices introspections, > i.e. from 132 (tricore) to over 10k (ppc 13046, ppc64 23426, arm > 82708, aarch64 89760). Median is ~1600, sum is ~260k. > > Except we actually test just 89k now, because

Re: [PATCH] tests: improve performance of device-introspect-test

2020-07-10 Thread Markus Armbruster
Daniel P. Berrangé writes: > Total execution time with "-m slow" and x86_64 QEMU, drops from 3 > minutes 15 seconds, down to 54 seconds. > > Individual tests drop from 17-20 seconds, down to 3-4 seconds. Nice! A few observations on this test (impatient readers may skip to "Conclusions"): * You

Re: [PATCH] tests: improve performance of device-introspect-test

2020-07-09 Thread Markus Armbruster
Laurent Vivier writes: > On 09/07/2020 13:59, Daniel P. Berrangé wrote: >> On Thu, Jul 09, 2020 at 01:44:45PM +0200, Laurent Vivier wrote: >>> On 09/07/2020 13:28, Daniel P. Berrangé wrote: Total execution time with "-m slow" and x86_64 QEMU, drops from 3 minutes 15 seconds, down to 54

Re: [PATCH] tests: improve performance of device-introspect-test

2020-07-09 Thread Laurent Vivier
On 09/07/2020 13:59, Daniel P. Berrangé wrote: > On Thu, Jul 09, 2020 at 01:44:45PM +0200, Laurent Vivier wrote: >> On 09/07/2020 13:28, Daniel P. Berrangé wrote: >>> Total execution time with "-m slow" and x86_64 QEMU, drops from 3 >>> minutes 15 seconds, down to 54 seconds. >>> >>> Individual tes

Re: [PATCH] tests: improve performance of device-introspect-test

2020-07-09 Thread Daniel P . Berrangé
On Thu, Jul 09, 2020 at 01:44:45PM +0200, Laurent Vivier wrote: > On 09/07/2020 13:28, Daniel P. Berrangé wrote: > > Total execution time with "-m slow" and x86_64 QEMU, drops from 3 > > minutes 15 seconds, down to 54 seconds. > > > > Individual tests drop from 17-20 seconds, down to 3-4 seconds.

Re: [PATCH] tests: improve performance of device-introspect-test

2020-07-09 Thread Laurent Vivier
On 09/07/2020 13:28, Daniel P. Berrangé wrote: > Total execution time with "-m slow" and x86_64 QEMU, drops from 3 > minutes 15 seconds, down to 54 seconds. > > Individual tests drop from 17-20 seconds, down to 3-4 seconds. > > The cost of this change is that any QOM bugs resulting in the test >

[PATCH] tests: improve performance of device-introspect-test

2020-07-09 Thread Daniel P . Berrangé
Total execution time with "-m slow" and x86_64 QEMU, drops from 3 minutes 15 seconds, down to 54 seconds. Individual tests drop from 17-20 seconds, down to 3-4 seconds. The cost of this change is that any QOM bugs resulting in the test failure will not be directly associated with the device that