On 1 December 2010 18:18, David Roe <r...@math.harvard.edu> wrote:
> I disagree that doctests should need to be independently verified.

I think we will have to agree to differ then.

> Of course, if we had an arbitrarily large amount of time to write doctests,
> then it would be a laudible goal.  Even now, I think there are situations
> where it would be reasonable to ask this of the author of a patch: if there
> was some indication of inconsistency for example.  And if someone wants to
> go through the Sage library adding such consistency checks, I think that's a
> great way to improve Sage.

So you admit it would improve stage to check the tests.

>  But it's already difficult enough to get code
> refereed without adding a requirement that code have such consistency
> checks.

It would probably be a bit easier to convince reviewers if your
doctests can be verified.

> The doctests that you object to fill two important roles:
> 1) they provide an example to a reader of the documentation how to use the
> function.

Yes, perhaps a confusing one if the answer is wrong. An embarrassing
one if the examples are wrong.

> 2) they provide a check so that if some change to the Sage library breaks
> something, we find out when testing.

> Until we have 100% doctest coverage, I think that's plenty.

100% covered of unverified tests is not worth a lot to me. What do you
propose we do when we get 100% coverage - go back and check if the
rests are valid or not? What a waste of time that would be. It would
be less overall effort to do the tests correctly the first time.

If you are going to give an example, how much longer does it take to
check if they are consistent with Mathematica or similar software? Or
chose an integral from a book?


Dave

-- 
To post to this group, send an email to sage-devel@googlegroups.com
To unsubscribe from this group, send an email to 
sage-devel+unsubscr...@googlegroups.com
For more options, visit this group at http://groups.google.com/group/sage-devel
URL: http://www.sagemath.org

Reply via email to