STINNER Victor added the comment:

Marc-Andre: "Consensus then was to use the minimum as basis for benchmarking: 
(...) There are arguments both pro and con using min or avg values."

To be honest, I expect that most developer are already aware that minimum is 
evil and so I wouldn't have to convince you. I already posted two links for the 
rationale. It seems that you are not convinced yet, it seems like I have to 
prepare a better rationale :-)

Quick rationale: the purpose of displaying the average rather than the minimum 
in timeit is to make timeit more *reliable*. My goal is that running timeit 5 
times would give exactly the same result. With the current design of timeit 
(only run one process), it's just impossible (for different reasons listed in 
my first article linked on this issue). But displaying the average is less 
worse than displaying the minimum to make results more reproductible.

----------

_______________________________________
Python tracker <rep...@bugs.python.org>
<http://bugs.python.org/issue28240>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

Reply via email to