Yes, this is a great idea. The benchmarks should be contained in some sort of database, and, the previous values on the same machine should be compared to the new values, and significant departures (both positively and negatively) listed. If performance degrades significantly on one test, it could even automatically generate a trac ticket (well some people might not think that this automatic generation is a good idea).
Victor On Sep 7, 1:32 pm, Robert Bradshaw <rober...@math.washington.edu> wrote: > On Sep 7, 2009, at 2:09 AM, Nathann Cohen wrote: > > > > > Hello everybody !!! > > > It is very nice that we have in Sage a way to automatically test > > our functions through docstrings which, besides, lead us to improve > > the documentation.... How hard could it be to find a similar way to > > measure the performance of Sage functions, something like a global > > benchmark we could run at each release of Sage, to check if we > > really improved the speed of the computings ? > > > Would it be possible to add in each docstring a "Benchmark :" > > section, with a few lines to be tested that could be nicely output > > in a beautiful html page containing all the results ? ( and maybe > > an historic of the previous releases ? ) > > > This way we could easily control our performances, and compare them > > to the other's.... ! > > This would be a great idea--and has been discussed before (though > never taken through to completion). Just for regression reasons alone > it would be nice to benchmark all the doctests, but marking some in > particular would be a good idea too. > > - Robert --~--~---------~--~----~------------~-------~--~----~ To post to this group, send an email to sage-devel@googlegroups.com To unsubscribe from this group, send an email to sage-devel-unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/sage-devel URLs: http://www.sagemath.org -~----------~----~----~----~------~----~------~--~---
