Go it, thanks Enrico Best, Xiaoyu Hou
Enrico Olivelli <eolive...@gmail.com> 于2022年7月12日周二 22:40写道： > Xiaoyu > > Il giorno mar 12 lug 2022 alle ore 16:36 Anon Hxy > <anonhx...@gmail.com> ha scritto: > > > > Hi Enrico > > > > I am interesting in working on this task. Could you please assign the > work > > to me? @AnonHxy > > > This is the issue > https://github.com/apache/pulsar/issues/16547 > > I am not sure I can "assign" the issue to you, but it is enough if you > post a comment "I am working on that" > > You will have to: > - create a prototype and see it working > - create a PIP and have it approved > - then we can commit your patch > > I will be happy to help you, feel free to reach out to me on slack > > Thanks > > Enrico > > > > Thanks, > > Xiaoyu Hou > > > > Enrico Olivelli <eolive...@gmail.com> 于2022年7月12日周二 22:28写道： > > > > > Thank you all ! > > > > > > I am going to create a issue/feature request > > > > > > Is there anyone interested in working on that ? > > > > > > We need a PIP. > > > The implementation probably won't be hard, but it may impact a few > > > test cases in the repo, because sometimes we turn on batching to > > > generate messages > > > and now if you don't write at least 2 messages (in a short time) the > > > producer will generate only a simple message. > > > > > > > > > > > > Enrico > > > > > > Il giorno mar 12 lug 2022 alle ore 15:55 guo jiwei > > > <techno...@apache.org> ha scritto: > > > > > > > > +1 > > > > Good idea > > > > > > > > Regards > > > > Jiwei Guo (Tboy) > > > > > > > > > > > > On Tue, Jul 12, 2022 at 9:07 PM PengHui Li <peng...@apache.org> > wrote: > > > > > > > > > +1 > > > > > > > > > > We should start with a proposal, so that we can clear on the > > > > > > > > > > On Tue, Jul 12, 2022 at 5:50 PM ZhangJian He <shoot...@gmail.com> > > > wrote: > > > > > > > > > > > +1 > > > > > > > > > > > > Thanks > > > > > > ZhangJian He > > > > > > > > > > > > Qiang Huang <qiang.huang1...@gmail.com> 于2022年7月12日周二 17:34写道： > > > > > > > > > > > > > +1 > > > > > > > Good idea! It will greatly reduce the resource consumption of > small > > > > > > > batches. > > > > > > > > > > > > > > Yubiao Feng <yubiao.f...@streamnative.io.invalid> > 于2022年7月12日周二 > > > > > 16:00写道： > > > > > > > > > > > > > > > +1 > > > > > > > > Good idea. > > > > > > > > > > > > > > > > Thanks > > > > > > > > Yubiao Feng > > > > > > > > > > > > > > > > On Tue, Jul 12, 2022 at 3:54 PM Enrico Olivelli < > > > eolive...@gmail.com > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > Hello, > > > > > > > > > I think that we could implement a small but effective > > > enhancement > > > > > to > > > > > > > > > batching. > > > > > > > > > > > > > > > > > > It may happen that even if you enable batching you come to > > > create > > > > > > > > > entries with 1 only message. > > > > > > > > > > > > > > > > > > Processing batch messages requires a good amount of > resources, > > > both > > > > > > on > > > > > > > > > the broker and on the client side. > > > > > > > > > > > > > > > > > > Especially when you are using PIP-105, Broker side > filtering, > > > you > > > > > > have > > > > > > > > > to unpack (and decompress) the whole entry in order to > process > > > the > > > > > > > > > very single message. > > > > > > > > > > > > > > > > > > So my proposal is to change the (Java) producer, to make it > > > > > produce a > > > > > > > > > regular message instead of a batch message if the batch > > > contains > > > > > only > > > > > > > > > 1 message > > > > > > > > > > > > > > > > > > Thoughts ? > > > > > > > > > > > > > > > > > > Enrico > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > BR, > > > > > > > Qiang Huang > > > > > > > > > > > > > > > > > > > > > >
