R. David Murray added the comment:

I think option 1 is to be preferred.  One of the things we've been talking 
about for the workflow is gating on the buildbots passing, and the way that 
works with flaky tests is if the check fails, you just run the test again so 
you get a green and the patch can be gated in.  So from that perspective if the 
tests pass on rerun the result is most useful if it is green.

Unless we want to say amber is OK for gating...but in terms of cognative load I 
think green is better.  After all, our current green state is morally 
equivalent to running the tests again and having them pass..

----------
nosy: +r.david.murray

_______________________________________
Python tracker <rep...@bugs.python.org>
<http://bugs.python.org/issue24751>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

Reply via email to