Il Sab 3 Apr 2021, 11:56 Lari Hotari <lari.hot...@sagire.fi> ha scritto:

> +1.
>
> For disabling, one could create a new TestNG group which just doesn't get
> run at all (or get runs without a failure blocking PR merge). Perhaps we
> could call this group "quarantine" or "quarantined"?
>

Works for me

Enrico

>
> -Lari
>
> On Sat, 3 Apr 2021, 12:06 Enrico Olivelli, <eolive...@gmail.com> wrote:
>
> > I propose to disable those tests and unblock CI and create blocker issues
> > for 2.8.0 release.
> > Issue are probably already present and I see a few PRs about tentative
> > fixes.
> >
> > Does this sound good?
> >
> > Enrico
> >
> > Il Ven 2 Apr 2021, 20:32 Enrico Olivelli <eolive...@gmail.com> ha
> scritto:
> >
> > > Jonathan
> > > I am not aware of commits that may have introduced instability
> > >
> > > Il Ven 2 Apr 2021, 20:17 Ali Ahmed <ahmal...@gmail.com> ha scritto:
> > >
> > >> If it's a few tests you can isolate it by running if after the group
> by
> > >> excluding it from it.
> > >>
> > >> or simply disable them for now.
> > >>
> > >
> > > Ali
> > > I am +1 to this idea.
> > >
> > > I cannot send a PR now
> > >
> > >
> > > Other ideas from the community?
> > >
> > > Enrico
> > >
> > >
> > >> On Fri, Apr 2, 2021 at 10:56 AM Enrico Olivelli <eolive...@gmail.com>
> > >> wrote:
> > >>
> > >> > Il Ven 2 Apr 2021, 18:47 Ali Ahmed <ahmal...@gmail.com> ha scritto:
> > >> >
> > >> > > You can rebuild the commit and force push this results in the job
> > >> being
> > >> > > queued on different machines. It ends helping the test pass.
> > >> > >
> > >> >
> > >> > I see these error on many PRs, and today I have restarted at least
> 20
> > >> jobs.
> > >> > Today (my timezone) we merged only 1pr, due to this problem
> > >> >
> > >> >
> > >> > Enrico
> > >> >
> > >> >
> > >> > > -Ali
> > >> > >
> > >> > > On Fri, Apr 2, 2021 at 9:09 AM Jonathan Ellis <jbel...@gmail.com>
> > >> wrote:
> > >> > >
> > >> > > > Is there a legit regression causing elevated failures?
> > >> > > >
> > >> > > > On Fri, Apr 2, 2021 at 10:30 AM Enrico Olivelli <
> > >> eolive...@gmail.com>
> > >> > > > wrote:
> > >> > > >
> > >> > > > > Hello,
> > >> > > > > today I see these tests (below) that are failing most of the
> PR
> > >> > > > > validation jobs that I am tracking.
> > >> > > > > it it literally the whole day that I am rerunning CI jobs,
> > without
> > >> > > > success
> > >> > > > >
> > >> > > > > What can we do ? Perhaps I am too pessimistic but it looks
> like
> > >> the
> > >> > > > > whole PR validation pipeline is stuck.
> > >> > > > >
> > >> > > > > Enrico
> > >> > > > >
> > >> > > > > Error:
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> testOrderingWithConsumerListener(org.apache.pulsar.client.api.KeySharedSubscriptionTest)
> > >> > > > >  Time elapsed: 1.912 s  <<< FAILURE!
> > >> > > > > 925
> > >> > > > > java.lang.AssertionError: expected [true] but found [false]
> > >> > > > >
> > >> > > > > Error:
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> testBrokerConnectionStats(org.apache.pulsar.broker.service.PersistentTopicE2ETest)
> > >> > > > >  Time elapsed: 0.275 s  <<< FAILURE!
> > >> > > > > java.lang.AssertionError: expected [0] but found [1]
> > >> > > > >
> > >> > > > > Error:
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> testRedeliveryFailOverConsumer(org.apache.pulsar.broker.service.persistent.SimpleProducerConsumerTestStreamingDispatcherTest)
> > >> > > > >  Time elapsed: 2.213 s  <<< FAILURE!
> > >> > > > > java.lang.AssertionError: expected [12] but found [11]
> > >> > > > >
> > >> > > > > Error:
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> testDeadLetterTopicByCustomTopicName(org.apache.pulsar.client.api.DeadLetterTopicTest)
> > >> > > > >  Time elapsed: 6.152 s  <<< FAILURE!
> > >> > > > > java.lang.AssertionError: expected [null] but found
> > >> > > > > [org.apache.pulsar.client.impl.MessageImpl@7feabb64]
> > >> > > > >
> > >> > > >
> > >> > > >
> > >> > > > --
> > >> > > > Jonathan Ellis
> > >> > > > co-founder, http://www.datastax.com
> > >> > > > @spyced
> > >> > > >
> > >> > >
> > >> > >
> > >> > > --
> > >> > > -Ali
> > >> > >
> > >> >
> > >>
> > >>
> > >> --
> > >> -Ali
> > >>
> > >
> >
>

Reply via email to