On Wed, Jan 24, 2018 at 5:20 AM, Ivan Kelly <iv...@apache.org> wrote:
> Hi folks, > > Looking at open PRs right now, there's a lot of red Xs > > https://screenshotscdn.firefoxusercontent.com/images/ > 8df9daf7-d71a-4988-a9cc-69d9c10c2636.png > > I see only 3 green. I know it's not all flakes, but a good amount of > it is. Enough to make a red X meaningless. > just fyi. I think we are much better these days. I typically found one of the jekinds CI passed at those red-Xs PRs. > > So I propose we enable the rerunFailingTest option in surefire. This > will rerun the flakes. I suggest we set to 2. Anything that it flaking > more than once per run needs to be looked at. > > http://maven.apache.org/surefire/maven-surefire-plugin/test-mojo.html# > rerunFailingTestsCount > > As part of this, I suggest that we also institute a no submission on > red policy (i.e. tests have to get full green to be merged). > > Regards, > Ivan >
