hi David

Thanks for all response. I have a couple of questions about the quarantine test 
and PR flow


Q0:

I am still a bit confused about “should we put new integration tests into 
quarantine manually/automatically?” To quote the KIP: “ Automatically placing a 
new test into the quarantine will allow us to observe its behavior without the 
risk of failing builds. After a few days of successful runs, these tests will 
graduate from the quarantine and be run as part of the main suite. ”

It seems those new tests will be placed into quarantine automatically. 

However, the next description: “ Placing a new test into the quarantine will be 
made at the discretion of the PR authors and/or committers. It should not be 
compulsory.”

It seems it is up to authors and/or committers.


Q1:

Could you please share more details about “ Placing a new test into the 
quarantine”? Do you mean “add the flaky annotation to the new integration tests 
in the PR”?


Q2:

Are the quarantine tests included by PR’s CI? If yes, could we (committers and 
author) ignore the failure of quarantine tests? If not, should we remove the 
retry from PR flow as the non-quarantine tests should be stable?

Best,
Chia-Ping

Reply via email to