Re: Fixing flaky tests: help needed

This is great news! On Fri, 12 Feb 2021 at 13:20, Lari Hotari wrote: > Hi all, > > There has been some great progress in fixing the flaky tests. It seems that > there's more stability in the builds after more fixes have been merged to > master. > This work has an impact. Thank you for the contri

Re: Fixing flaky tests: help needed

Hi all, There has been some great progress in fixing the flaky tests. It seems that there's more stability in the builds after more fixes have been merged to master. This work has an impact. Thank you for the contributions. Our work is not over. There's a lot more to fix. Please continue contribu

Re: Fixing flaky tests: help needed

Hi all, Here's the next batch of flaky test issues: #9459 Flaky-test: PulsarFunctionsTest.testDebeziumPostgreSqlSource #9458 Flaky-test: ReplicatorTest.testReplication #9457 Flaky-test:ReplicatorTest.t

Re: Fixing flaky tests: help needed

Hi all, There are links to recent failures of a particular flaky test in the recently reported flaky test GitHub issues ( https://github.com/apache/pulsar/issues?q=flaky+sort%3Aupdated-desc+is%3Aissue+is%3Aopen ). Example from https://github.com/apache/pulsar/issues/9437 : example failure 2021-02

Re: Fixing flaky tests: help needed

The good progress continues! One way to see the issue & PR activity where "flaky" is mentioned: https://github.com/apache/pulsar/issues?q=flaky+sort%3Aupdated-desc Thank you to the contributors and PR reviewers! Here's the next flaky test for someone to fix: https://github.com/apache/pulsar/issues

Re: Fixing flaky tests: help needed

Dear Pulsar community members, Thanks for picking up the work so quickly! I noticed that at least Renkai and Michael already pushed pull requests to fix the flaky tests that were mentioned in the previous email. Some of the PRs have already been merged. Here are 3 more flaky tests with links to a

Re: Fixing flaky tests: help needed

Good idea. I have created https://github.com/apache/pulsar/pull/9398 for adding the issue template for reporting flaky tests. BR, Lari On Sat, Jan 30, 2021 at 8:51 PM Sijie Guo wrote: > > I've been > using this type of template for reporting a flaky test: > https://gist.github.com/lhotari/a5c67

Re: Fixing flaky tests: help needed

> I've been using this type of template for reporting a flaky test: https://gist.github.com/lhotari/a5c67359b362b4f3d8729330d65a2298 . Can you add an issue template to Pulsar? - Sijie On Fri, Jan 29, 2021 at 10:27 AM Lari Hotari wrote: > Dear Pulsar community members, > > In order to improve

Fixing flaky tests: help needed

Dear Pulsar community members, In order to improve our CI, we will have to fix the flaky tests. In some cases it might be necessary to replace an existing test with a redesigned test. The draft PIP "Changes to flaky test handling" document