[sage-devel] Re: Regression testing

2010-10-26 Thread Johan S. R. Nielsen
+1 to the idea of time testing doctests. I would use them all the time for regression testing and when testing improvements; not the least for my own Sage "library". It seems to me that only very rarely it would be interesting to look at other's timing tests, and so, I don't really think the extra

[sage-devel] Re: Regression testing

2010-10-25 Thread Nick Alexander
> One could modify local/bin/sage-doctest to allow the option of changing each > doctest by wrapping it in a "timeit()" call.  This would then generate a > timing datum for each doctest line. I did this, a long long time ago. Not clear whether it was ever merged. See: http://trac.sagemath.org/s

[sage-devel] Re: Regression testing

2010-10-25 Thread Donald Alan Morrison
On Oct 25, 4:23 pm, Mitesh Patel wrote: >>[...] > On 10/25/2010 01:54 PM, William Stein wrote: > >   * A document with a unique id, starting at 0, for each actual test > >        {'id':0, 'code':'factor(2^127+1)'} > > >   * A document for each result of running the tests on an actual platform: >

[sage-devel] Re: Regression testing

2010-10-25 Thread Donald Alan Morrison
On Oct 25, 2:47 pm, "Dr. David Kirkby" wrote: > On 10/25/10 04:50 PM, Donald Alan Morrison wrote: > > On Oct 25, 8:19 am, David Kirkby  wrote: > >> Getting a checksum of each doctest would be easy. I suggest we use: > >> $ cksum sometest.py  | awk '{print $1}' > >> because that will be totally p

Re: [sage-devel] Re: Regression testing

2010-10-25 Thread Dr. David Kirkby
On 10/25/10 04:50 PM, Donald Alan Morrison wrote: On Oct 25, 8:19 am, David Kirkby wrote: Getting a checksum of each doctest would be easy. I suggest we use: $ cksum sometest.py | awk '{print $1}' because that will be totally portable across all platforms. 'cksum' is 32-bit checksum that's

[sage-devel] Re: Regression testing

2010-10-25 Thread Donald Alan Morrison
On Oct 25, 8:19 am, David Kirkby wrote: > Getting a checksum of each doctest would be easy. I suggest we use: > > $ cksum sometest.py  | awk '{print $1}' > > because that will be totally portable across all platforms. 'cksum' is > 32-bit checksum that's part of the POSIX standard and the algorit

[sage-devel] Re: Regression testing

2010-10-21 Thread koffie
This would be a good addition to the sage developement process indeed. Before going trough all the work of implementing this stuff, it might be wise to first look what's already out there. It might prevent you from doing double work, or give inspiration on how to do it. There seems to be a package