The only blocker now should be https://github.com/apache/pulsar/issues/17520 The description says that reverting BK to 4.15.0, the issue seems resolved.
If so, I think we should revert the BK upgrade and then go forward with Pulsar 2.11.0. I know that there are some suspects of a regression in BK 4.15.0 raised by the Pravega team (https://github.com/apache/bookkeeper/issues/3466) but we can't wait for them. We don't know if the same issue applies to Pulsar and the time for: find the issue - fix it - cut a release may be weeks or months. Nicolò Boschi Il giorno lun 5 set 2022 alle ore 14:03 Enrico Olivelli <eolive...@gmail.com> ha scritto: > Got it > thanks fro the update and also thanks for being so careful in > following the issues > and we are finding on Pulsar > > Il giorno lun 5 set 2022 alle ore 13:00 guo jiwei > <techno...@apache.org> ha scritto: > > > > Hi dev, > > We find two new issues[1] that block the release. > > After the two issues are resolved, I will start the release. > > > > [1] : https://github.com/apache/pulsar/pull/17474 > > https://github.com/apache/bookkeeper/issues/3466 > > This is a BookKeeper bug, so it will take much time to see it fixed > and released in order to be > consumed by Pulsar. > > The issue was reported on Pravega, that uses BK in a very different way. > I am not sure that we have to hold off this release waiting for > feedback on that issue > > The 2.11 release was due to August, before PulsarSummit > > any other opinions from the community ? > > > Enrico > > > > > Regards > > Jiwei Guo (Tboy) > > > > > > On Fri, Aug 26, 2022 at 10:02 AM guo jiwei <techno...@apache.org> wrote: > > > > > Hi Anon > > > After we cut the branch, the code freezed. > > > > > > > > > Regards > > > Jiwei Guo (Tboy) > > > > > > > > > On Thu, Aug 25, 2022 at 9:45 PM Anon Hxy <anonhx...@gmail.com> wrote: > > > > > >> Hi jiwei > > >> > > >> Sorry for late reply. I'd like to add PIP189 to 2.11.0, is it > possible > > >> now > > >> > > >> - PIP 189: No batching if only one message in batch. > > >> https://github.com/apache/pulsar/pull/16605 > > >> > > >> Thanks, > > >> Xiaoyu Hou > > >> > > >> guo jiwei <techno...@apache.org> 于2022年8月24日周三 10:16写道： > > >> > > >> > Hi all, > > >> > We have merged all the blocker patches, and I decide to start the > > >> > release. > > >> > The release note[1] for 2.11.0 is available for review, please > help > > >> > review it and feel free to leave comments. > > >> > > > >> > > > >> > [1] https://github.com/apache/pulsar-site/pull/167 > > >> > > > >> > > > >> > Regards > > >> > Jiwei Guo (Tboy) > > >> > > > >> > > > >> > On Wed, Aug 17, 2022 at 10:43 PM Enrico Olivelli < > eolive...@gmail.com> > > >> > wrote: > > >> > > > >> > > This test is blocking all the PRs and so it is blocking the > release: > > >> > > Error: Tests run: 9, Failures: 2, Errors: 0, Skipped: 3, Time > elapsed: > > >> > > 21.724 s <<< FAILURE! - in > > >> > > org.apache.pulsar.client.impl.MultiTopicsConsumerImplTest > > >> > > 3681 Error: > > >> > > > > >> > > > >> > testParallelSubscribeAsync(org.apache.pulsar.client.impl.MultiTopicsConsumerImplTest) > > >> > > Time elapsed: 5.05 s <<< FAILURE! > > >> > > org.testng.internal.thread.ThreadTimeoutException: Method > > >> > > > > >> > > > > >> > > > >> > org.apache.pulsar.client.impl.MultiTopicsConsumerImplTest.testParallelSubscribeAsync() > > >> > > didn't finish within the time-out 5000 > > >> > > > > >> > > > > >> > > Enrico > > >> > > > > >> > > Il giorno mer 17 ago 2022 alle ore 14:40 Nicolò Boschi > > >> > > <boschi1...@gmail.com> ha scritto: > > >> > > > > > >> > > > This is another blocker for 2.11.0 for a regression about > streaming > > >> > > > dispatch that I found in the 2.11 branch > > >> > > > https://github.com/apache/pulsar/pull/17143 > > >> > > > > > >> > > > Nicolò Boschi > > >> > > > > > >> > > > > > >> > > > Il giorno mer 17 ago 2022 alle ore 11:45 Enrico Olivelli < > > >> > > > eolive...@gmail.com> ha scritto: > > >> > > > > > >> > > > > We have this release blocker PR that is waiting for CI > > >> > > > > https://github.com/apache/pulsar/pull/17118 > > >> > > > > the problem is about a new API that has been introduced in > 2.11 > > >> but > > >> > > > > the API has a little problem and we must fix it before the > API to > > >> be > > >> > > > > released to the public > > >> > > > > > > >> > > > > Enrico > > >> > > > > > > >> > > > > Il giorno mar 16 ago 2022 alle ore 10:13 guo jiwei > > >> > > > > <techno...@apache.org> ha scritto: > > >> > > > > > > > >> > > > > > Thanks for Yunze's help for fixing rpm and deb packaging. > > >> > > > > > > > >> > > > > > > > >> > > > > > Regards > > >> > > > > > Jiwei Guo (Tboy) > > >> > > > > > > > >> > > > > > > > >> > > > > > On Wed, Aug 10, 2022 at 11:02 PM Yunze Xu > > >> > > <y...@streamnative.io.invalid> > > >> > > > > > wrote: > > >> > > > > > > > >> > > > > > > I found the scripts to build rpm and deb packages are > broken, > > >> see > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > >> > > > > >> > > > >> > https://github.com/apache/pulsar/wiki/Release-process#31-build-rpm-and-deb-packages > > >> > > > > > > . > > >> > > > > > > > > >> > > > > > > It's caused by > https://github.com/apache/pulsar/pull/15376 > > >> and > > >> > > only > > >> > > > > > > affects the 2.11.0 release and higher versions. It should > be a > > >> > > blocker > > >> > > > > > > for 2.11.0 release. I'm working on this issue at the > moment > > >> and > > >> > > going > > >> > > > > > > to push a fix soon, as well as the CI to protect the > rpm/deb > > >> > > packaging > > >> > > > > > > to avoid the regression. > > >> > > > > > > > > >> > > > > > > Thanks, > > >> > > > > > > Yunze > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > > 2022年8月4日 23:44，guo jiwei <techno...@apache.org> 写道： > > >> > > > > > > > > > >> > > > > > > > Hi all, > > >> > > > > > > > > > >> > > > > > > > Put an update here, we have created branch-2.11[1]. > > >> > > > > > > > > > >> > > > > > > > [1] https://github.com/apache/pulsar/tree/branch-2.11 > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > Regards > > >> > > > > > > > Jiwei Guo (Tboy) > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > On Wed, Jul 27, 2022 at 10:59 AM Zixuan Liu < > > >> node...@gmail.com > > >> > > > > >> > > > > wrote: > > >> > > > > > > > > > >> > > > > > > >> +1 > > >> > > > > > > >> > > >> > > > > > > >> Thanks, > > >> > > > > > > >> Zixuan > > >> > > > > > > >> > > >> > > > > > > >> Yunze Xu <y...@streamnative.io.invalid> 于2022年7月26日周二 > > >> > 23:34写道： > > >> > > > > > > >> > > >> > > > > > > >>> I opened a PR > https://github.com/apache/pulsar/pull/16803 > > >> > that > > >> > > > > might > > >> > > > > > > be > > >> > > > > > > >>> the blocker > > >> > > > > > > >>> of the release of 2.11.0, PTAL. > > >> > > > > > > >>> > > >> > > > > > > >>> Thanks, > > >> > > > > > > >>> Yunze > > >> > > > > > > >>> > > >> > > > > > > >>> > > >> > > > > > > >>> > > >> > > > > > > >>> > > >> > > > > > > >>>> 2022年7月22日 18:21，Zixuan Liu <node...@gmail.com> 写道： > > >> > > > > > > >>>> > > >> > > > > > > >>>> +1 > > >> > > > > > > >>>> > > >> > > > > > > >>>> Thanks, > > >> > > > > > > >>>> Zixuan > > >> > > > > > > >>>> > > >> > > > > > > >>>> Enrico Olivelli <eolive...@gmail.com> 于2022年7月22日周五 > > >> > 18:06写道： > > >> > > > > > > >>>> > > >> > > > > > > >>>>> Il giorno ven 22 lug 2022 alle ore 12:05 guo jiwei > > >> > > > > > > >>>>> <techno...@apache.org> ha scritto: > > >> > > > > > > >>>>>> > > >> > > > > > > >>>>>> I will take the release > > >> > > > > > > >>>>> > > >> > > > > > > >>>>> Thanks ! > > >> > > > > > > >>>>> > > >> > > > > > > >>>>> Enrico > > >> > > > > > > >>>>> > > >> > > > > > > >>>>>> > > >> > > > > > > >>>>>> Regards > > >> > > > > > > >>>>>> Jiwei Guo (Tboy) > > >> > > > > > > >>>>>> > > >> > > > > > > >>>>>> > > >> > > > > > > >>>>>> On Fri, Jul 22, 2022 at 12:37 AM Nicolò Boschi < > > >> > > > > > > boschi1...@gmail.com > > >> > > > > > > >>> > > >> > > > > > > >>>>> wrote: > > >> > > > > > > >>>>>> > > >> > > > > > > >>>>>>> I understand the need for the Pulsar Summit. > > >> > > > > > > >>>>>>> > > >> > > > > > > >>>>>>> In that case I have to step back because I will be > > >> > offline > > >> > > for > > >> > > > > the > > >> > > > > > > >>>>> next few > > >> > > > > > > >>>>>>> weeks > > >> > > > > > > >>>>>>> Sorry > > >> > > > > > > >>>>>>> > > >> > > > > > > >>>>>>> Nicolò Boschi > > >> > > > > > > >>>>>>> > > >> > > > > > > >>>>>>> Il Gio 21 Lug 2022, 06:32 PengHui Li < > > >> peng...@apache.org > > >> > > > > >> > > ha > > >> > > > > > > >> scritto: > > >> > > > > > > >>>>>>> > > >> > > > > > > >>>>>>>> Thanks for volunteering Nicolò. > > >> > > > > > > >>>>>>>> > > >> > > > > > > >>>>>>>>> So a plan could be to try to merge the work in > > >> progress > > >> > > > > targeted > > >> > > > > > > >>>>> for > > >> > > > > > > >>>>>>> 2.11 > > >> > > > > > > >>>>>>>> by the mid of August and then start the code > > >> freezing as > > >> > > > > described > > >> > > > > > > >>>>> in the > > >> > > > > > > >>>>>>>> PIP. > > >> > > > > > > >>>>>>>> > > >> > > > > > > >>>>>>>> So the target release date will be early > September. > > >> One > > >> > > point > > >> > > > > is > > >> > > > > > > >>>>> Pulsar > > >> > > > > > > >>>>>>>> Summit > > >> > > > > > > >>>>>>>> San Francisco will start on August 18, 2022. I > think > > >> > > maybe we > > >> > > > > can > > >> > > > > > > >>>>> start > > >> > > > > > > >>>>>>> to > > >> > > > > > > >>>>>>>> test > > >> > > > > > > >>>>>>>> the master branch for now and continue the > > >> in-progress > > >> > > tasks. > > >> > > > > If > > >> > > > > > > we > > >> > > > > > > >>>>> can > > >> > > > > > > >>>>>>>> have a > > >> > > > > > > >>>>>>>> major release before Pulsar Summit, it should be > good > > >> > > news to > > >> > > > > the > > >> > > > > > > >>>>>>>> Community. > > >> > > > > > > >>>>>>>> > > >> > > > > > > >>>>>>>> Thanks. > > >> > > > > > > >>>>>>>> Penghui > > >> > > > > > > >>>>>>>> > > >> > > > > > > >>>>>>>> On Mon, Jul 18, 2022 at 4:06 PM Enrico Olivelli < > > >> > > > > > > >> eolive...@gmail.com > > >> > > > > > > >>>>>> > > >> > > > > > > >>>>>>>> wrote: > > >> > > > > > > >>>>>>>> > > >> > > > > > > >>>>>>>>> Nicolò, > > >> > > > > > > >>>>>>>>> > > >> > > > > > > >>>>>>>>> Il Lun 18 Lug 2022, 10:00 Nicolò Boschi < > > >> > > > > boschi1...@gmail.com> > > >> > > > > > > ha > > >> > > > > > > >>>>>>>> scritto: > > >> > > > > > > >>>>>>>>> > > >> > > > > > > >>>>>>>>>> Thanks Penghui for the reminder. > > >> > > > > > > >>>>>>>>>> I'd like to also include PIP: 181 Pulsar shell > if > > >> the > > >> > > time > > >> > > > > > > >>>>> permits. > > >> > > > > > > >>>>>>>>>> > > >> > > > > > > >>>>>>>>>> I believe that is a good idea to start testing > the > > >> > code > > >> > > > > freeze > > >> > > > > > > >>>>>>> proposed > > >> > > > > > > >>>>>>>>> by > > >> > > > > > > >>>>>>>>>> PIP-175 ( > > >> > https://github.com/apache/pulsar/issues/15966 > > >> > > ). > > >> > > > > Even > > >> > > > > > > >>>>> if not > > >> > > > > > > >>>>>>>>>> officially approved, we discussed it many > times and > > >> > > agreed > > >> > > > > to > > >> > > > > > > the > > >> > > > > > > >>>>>>>>>> usefulness of the code freezing. > > >> > > > > > > >>>>>>>>>> > > >> > > > > > > >>>>>>>>> > > >> > > > > > > >>>>>>>>> Great idea! > > >> > > > > > > >>>>>>>>> > > >> > > > > > > >>>>>>>>> We should really try it > > >> > > > > > > >>>>>>>>> > > >> > > > > > > >>>>>>>>> So a plan could be to try to merge the work in > > >> progress > > >> > > > > targeted > > >> > > > > > > >>>>> for > > >> > > > > > > >>>>>>> 2.11 > > >> > > > > > > >>>>>>>>>> by the mid of August and then start the code > > >> freezing > > >> > as > > >> > > > > > > >>>>> described in > > >> > > > > > > >>>>>>>> the > > >> > > > > > > >>>>>>>>>> PIP. > > >> > > > > > > >>>>>>>>>> > > >> > > > > > > >>>>>>>>>> Also, I volunteer for driving the release if > nobody > > >> > > else is > > >> > > > > > > >>>>>>> interested > > >> > > > > > > >>>>>>>>>> > > >> > > > > > > >>>>>>>>> > > >> > > > > > > >>>>>>>>> > > >> > > > > > > >>>>>>>>> Thanks for volunteering > > >> > > > > > > >>>>>>>>> > > >> > > > > > > >>>>>>>>> Enrico > > >> > > > > > > >>>>>>>>> > > >> > > > > > > >>>>>>>>> > > >> > > > > > > >>>>>>>>>> Thanks, > > >> > > > > > > >>>>>>>>>> Nicolò Boschi > > >> > > > > > > >>>>>>>>>> > > >> > > > > > > >>>>>>>>>> > > >> > > > > > > >>>>>>>>>> Il giorno lun 18 lug 2022 alle ore 06:59 Yunze > Xu > > >> > > > > > > >>>>>>>>>> <y...@streamnative.io.invalid> ha scritto: > > >> > > > > > > >>>>>>>>>> > > >> > > > > > > >>>>>>>>>>> In addition to #16202, there is a following > PR to > > >> > > support > > >> > > > > the > > >> > > > > > > >>>>>>> correct > > >> > > > > > > >>>>>>>>>>> ACK implementation for chunked messages. It > should > > >> > > depend > > >> > > > > on > > >> > > > > > > >>>>> #16202 > > >> > > > > > > >>>>>>>>>>> But I think I can submit an initial PR this > week > > >> and > > >> > > > > change the > > >> > > > > > > >>>>>>> tests > > >> > > > > > > >>>>>>>>>>> after #16202 is merged. > > >> > > > > > > >>>>>>>>>>> > > >> > > > > > > >>>>>>>>>>> Thanks, > > >> > > > > > > >>>>>>>>>>> Yunze > > >> > > > > > > >>>>>>>>>>> > > >> > > > > > > >>>>>>>>>>> > > >> > > > > > > >>>>>>>>>>> > > >> > > > > > > >>>>>>>>>>> > > >> > > > > > > >>>>>>>>>>>> 2022年7月18日 11:22，PengHui Li < > peng...@apache.org> > > >> > 写道： > > >> > > > > > > >>>>>>>>>>>> > > >> > > > > > > >>>>>>>>>>>> Hi all, > > >> > > > > > > >>>>>>>>>>>> > > >> > > > > > > >>>>>>>>>>>> We released 2.10.0 three months ago. And > there > > >> are > > >> > > many > > >> > > > > great > > >> > > > > > > >>>>>>>> changes > > >> > > > > > > >>>>>>>>>> in > > >> > > > > > > >>>>>>>>>>>> the master branch, > > >> > > > > > > >>>>>>>>>>>> including new features and performance > > >> improvements. > > >> > > > > > > >>>>>>>>>>>> > > >> > > > > > > >>>>>>>>>>>> - PIP 74: apply client memory to consumer > > >> > > > > > > >>>>>>>>>>>> https://github.com/apache/pulsar/pull/15216 > > >> > > > > > > >>>>>>>>>>>> - PIP 143: Support split bundles by specified > > >> > > boundaries > > >> > > > > > > >>>>>>>>>>>> https://github.com/apache/pulsar/pull/13796 > > >> > > > > > > >>>>>>>>>>>> - PIP 145: regex subscription improvements > > >> > > > > > > >>>>>>>>>>>> https://github.com/apache/pulsar/pull/16062 > > >> > > > > > > >>>>>>>>>>>> - PIP 160: transaction performance > improvements > > >> > > (still in > > >> > > > > > > >>>>>>> progress > > >> > > > > > > >>>>>>>>> and > > >> > > > > > > >>>>>>>>>>>> merged some PRs) > > >> > > > > > > >>>>>>>>>>>> - PIP 161: new exclusive producer mode > support > > >> > > > > > > >>>>>>>>>>>> https://github.com/apache/pulsar/pull/15488 > > >> > > > > > > >>>>>>>>>>>> - PIP 182: Provide new load balance placement > > >> > strategy > > >> > > > > > > >>>>>>>> implementation > > >> > > > > > > >>>>>>>>>> for > > >> > > > > > > >>>>>>>>>>>> ModularLoadManagerStrategy > > >> > > > > > > >>>>>>>>> https://github.com/apache/pulsar/pull/16281 > > >> > > > > > > >>>>>>>>>>>> Add Pulsar Auth support for the Pulsar SQL > > >> > > > > > > >>>>>>>>>>>> https://github.com/apache/pulsar/pull/15571 > > >> > > > > > > >>>>>>>>>>>> > > >> > > > > > > >>>>>>>>>>>> And some features are blocked in the review > > >> stage, > > >> > but > > >> > > > > they > > >> > > > > > > >>>>> are > > >> > > > > > > >>>>>>>>>> powerful > > >> > > > > > > >>>>>>>>>>>> improvements for Pulsar > > >> > > > > > > >>>>>>>>>>>> > > >> > > > > > > >>>>>>>>>>>> PIP 37: Support chunking with Shared > subscription > > >> > > > > > > >>>>>>>>>>>> https://github.com/apache/pulsar/pull/16202 > > >> > > > > > > >>>>>>>>>>>> PIP-166: Function add MANUAL delivery > semantics > > >> > > > > > > >>>>>>>>>>>> https://github.com/apache/pulsar/pull/16279 > > >> > > > > > > >>>>>>>>>>>> > > >> > > > > > > >>>>>>>>>>>> You can find the complete change list in > 2.11.0 > > >> at > > >> > > > > > > >>>>>>>>>>>> > > >> > > > > > > >>>>>>>>>>> > > >> > > > > > > >>>>>>>>>> > > >> > > > > > > >>>>>>>>> > > >> > > > > > > >>>>>>>> > > >> > > > > > > >>>>>>> > > >> > > > > > > >>>>> > > >> > > > > > > >>> > > >> > > > > > > >> > > >> > > > > > > > > >> > > > > > > >> > > > > >> > > > >> > https://github.com/apache/pulsar/pulls?q=is%3Apr+milestone%3A2.11.0+-label%3Arelease%2F2.10.1+-label%3Arelease%2F2.10.2 > > >> > > > > > > >>>>>>>>>>>> > > >> > > > > > > >>>>>>>>>>>> And maybe I missed some important in-progress > > >> PRs, > > >> > > please > > >> > > > > > > >>>>> let me > > >> > > > > > > >>>>>>>> know > > >> > > > > > > >>>>>>>>>> if > > >> > > > > > > >>>>>>>>>>> it > > >> > > > > > > >>>>>>>>>>>> should be a blocker of the 2.11.0 release. > > >> > > > > > > >>>>>>>>>>>> > > >> > > > > > > >>>>>>>>>>>> It's a good time to discuss the target time > of > > >> the > > >> > > 2.11.0 > > >> > > > > > > >>>>>>> release. > > >> > > > > > > >>>>>>>>>>>> I think we can leave 2 weeks to complete the > > >> > > in-progress > > >> > > > > PRs > > >> > > > > > > >>>>> and > > >> > > > > > > >>>>>>> 2 > > >> > > > > > > >>>>>>>>>> weeks > > >> > > > > > > >>>>>>>>>>> to > > >> > > > > > > >>>>>>>>>>>> accept bug fixes. > > >> > > > > > > >>>>>>>>>>>> And target the 2.11.0 release in mid-August. > > >> > > > > > > >>>>>>>>>>>> > > >> > > > > > > >>>>>>>>>>>> Please let me know what you think. > > >> > > > > > > >>>>>>>>>>>> > > >> > > > > > > >>>>>>>>>>>> Thanks, > > >> > > > > > > >>>>>>>>>>>> Penghui > > >> > > > > > > >>>>>>>>>>> > > >> > > > > > > >>>>>>>>>>> > > >> > > > > > > >>>>>>>>>> > > >> > > > > > > >>>>>>>>> > > >> > > > > > > >>>>>>>> > > >> > > > > > > >>>>>>> > > >> > > > > > > >>>>> > > >> > > > > > > >>> > > >> > > > > > > >>> > > >> > > > > > > >> > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > >> > > > > >> > > > >> > > > >
