On Mon, Mar 28, 2011 at 5:42 PM, John Beranek <j...@redux.org.uk> wrote: > On 25/03/2011 17:33, Mark Phippard wrote: >> Hi, >> >> I have been working on a framework for writing tests to record >> performance. I have something good enough to share: > > May I make an observation about these benchmarks...? > > When I provided some benchmarks that included 'checkout' tests I was > specifically asked to make tests that separate WC and RA functionality. > > I did this, released results, and the (portable) benchmark code.
If your point is why didn't I use your code it is becuase it is in Perl and I do not know Perl. I also did not see any conversation happening around your benchmarks (or else I would not have bothered to try get things going again). I have tried to make it clear that this is just something I decided to work on to help. Whether it means anything or not or whether we use these benchmarks to make decisions remains to be seen. Feel free to try to revive discussion around the tests you wrote, I will not be offended. > Now Mark has released a new set of benchmarks, which don't separate WC > and RA functionality. No one has (yet) noted this fact. ;) I focused my tests on WC functions. I am not sure what you mean by RA functionality. Some of our biggest problems are in walking the tree during things like update and commit. So we have to run those commands in order to see the performance issues. I have created WC's with three different "shapes" to show different areas where there might be problems. I have avoided all purely RA functions like log and I also do not bother to repeatedly show the results for commands like checkout. I generally show it once for each shape working copy and then just skip reporting how long it took in subsequent tests. Anyway, I was not trying to offend you. I just wanted to help and I have no desire to learn Perl (or even Python which obviously would have been preferred). I was going to find the email where you posted your tests, but since I never recalled anyone else running them or discussing them I did not see the benefit in doing so and it would not have accomplished my goal to help. -- Thanks Mark Phippard http://markphip.blogspot.com/
