Hi folks,

Looking at open PRs right now, there's a lot of red Xs

https://screenshotscdn.firefoxusercontent.com/images/8df9daf7-d71a-4988-a9cc-69d9c10c2636.png

I see only 3 green. I know it's not all flakes, but a good amount of
it is. Enough to make a red X meaningless.

So I propose we enable the rerunFailingTest option in surefire. This
will rerun the flakes. I suggest we set to 2. Anything that it flaking
more than once per run needs to be looked at.

http://maven.apache.org/surefire/maven-surefire-plugin/test-mojo.html#rerunFailingTestsCount

As part of this, I suggest that we also institute a no submission on
red policy (i.e. tests have to get full green to be merged).

Regards,
Ivan

Reply via email to