On 06 April 2014 14:58:24, Ehsan Akhgari wrote:
On 2014-04-06, 8:59 AM, Aryeh Gregor wrote:
Is there any reason in principle that we couldn't have the test runner
automatically rerun tests with known intermittent failures a few
times, and let the test pass if it passes a few times in a row after
the first fail?
I don't think there is a good reason not to do that. Please file a bug!
xpcshell already does this, bug 918921 is filed for mochitests, though
dbaron raises valid concerns in the bug.
That said, I think something that would be worth doing (and is now more
viable now that we've nearing completion for switching to manifests for
tests) is having a 'mochitest-flaky' where tests that are marked in the
manifest as being unreliable are run. (Similar to what the Chomium
project currently does).
Cheers,
Ed
_______________________________________________
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform
