hi David Thanks for all response. I have a couple of questions about the quarantine test and PR flow
Q0: I am still a bit confused about “should we put new integration tests into quarantine manually/automatically?” To quote the KIP: “ Automatically placing a new test into the quarantine will allow us to observe its behavior without the risk of failing builds. After a few days of successful runs, these tests will graduate from the quarantine and be run as part of the main suite. ” It seems those new tests will be placed into quarantine automatically. However, the next description: “ Placing a new test into the quarantine will be made at the discretion of the PR authors and/or committers. It should not be compulsory.” It seems it is up to authors and/or committers. Q1: Could you please share more details about “ Placing a new test into the quarantine”? Do you mean “add the flaky annotation to the new integration tests in the PR”? Q2: Are the quarantine tests included by PR’s CI? If yes, could we (committers and author) ignore the failure of quarantine tests? If not, should we remove the retry from PR flow as the non-quarantine tests should be stable? Best, Chia-Ping
