Re: [RFC] Performance test framework

2015-06-19 Thread Gerry Boland
On 19/06/15 11:22, Alexandros Frantzis wrote: > Hello all, > > there have recently been a few occasions where we wanted to experiment with > performance improvements, but lacked a way to easily measure their effect. > There have also been a few occasions where different implementations of the > (s

Re: [RFC] Performance test framework

2015-06-19 Thread Alexandros Frantzis
On Fri, Jun 19, 2015 at 11:55:54AM +0100, Alan Griffiths wrote: > On 19/06/15 11:52, Alan Griffiths wrote: > > On 19/06/15 11:22, Alexandros Frantzis wrote: > >> Hello all, > >> > >> there have recently been a few occasions where we wanted to experiment with > >> performance improvements, but lacke

Re: [RFC] Performance test framework

2015-06-19 Thread Kevin DuBois
I'm okay with using python to execute the performance tests and gather/parse lttng traces via babeltrace (it seems a decent api for processing api traces). I agree that its better if we can visualize the data nicely, but we have to deal with the problem that we're not collecting this data at all ri

Re: [RFC] Performance test framework

2015-06-19 Thread Andreas Pokorny
Hi, On Fri, Jun 19, 2015 at 12:22 PM, Alexandros Frantzis < alexandros.frant...@canonical.com> wrote: > > So, what I would like to hear from you is: > > 1. Your general preference for python vs C++ for the test scripts > 2. Any particular performance tests that you would like to see implemented,

Re: [RFC] Performance test framework

2015-06-19 Thread Alan Griffiths
On 19/06/15 11:52, Alan Griffiths wrote: > On 19/06/15 11:22, Alexandros Frantzis wrote: >> Hello all, >> >> there have recently been a few occasions where we wanted to experiment with >> performance improvements, but lacked a way to easily measure their effect. >> There have also been a few occasi

Re: [RFC] Performance test framework

2015-06-19 Thread Alan Griffiths
On 19/06/15 11:22, Alexandros Frantzis wrote: > Hello all, > > there have recently been a few occasions where we wanted to experiment with > performance improvements, but lacked a way to easily measure their effect. > There have also been a few occasions where different implementations of the > (su

[RFC] Performance test framework

2015-06-19 Thread Alexandros Frantzis
Hello all, there have recently been a few occasions where we wanted to experiment with performance improvements, but lacked a way to easily measure their effect. There have also been a few occasions where different implementations of the (supposedly) same performance test came up with different re