+1 We should start with a proposal, so that we can clear on the
On Tue, Jul 12, 2022 at 5:50 PM ZhangJian He <shoot...@gmail.com> wrote: > +1 > > Thanks > ZhangJian He > > Qiang Huang <qiang.huang1...@gmail.com> 于2022年7月12日周二 17:34写道： > > > +1 > > Good idea! It will greatly reduce the resource consumption of small > > batches. > > > > Yubiao Feng <yubiao.f...@streamnative.io.invalid> 于2022年7月12日周二 16:00写道： > > > > > +1 > > > Good idea. > > > > > > Thanks > > > Yubiao Feng > > > > > > On Tue, Jul 12, 2022 at 3:54 PM Enrico Olivelli <eolive...@gmail.com> > > > wrote: > > > > > > > Hello, > > > > I think that we could implement a small but effective enhancement to > > > > batching. > > > > > > > > It may happen that even if you enable batching you come to create > > > > entries with 1 only message. > > > > > > > > Processing batch messages requires a good amount of resources, both > on > > > > the broker and on the client side. > > > > > > > > Especially when you are using PIP-105, Broker side filtering, you > have > > > > to unpack (and decompress) the whole entry in order to process the > > > > very single message. > > > > > > > > So my proposal is to change the (Java) producer, to make it produce a > > > > regular message instead of a batch message if the batch contains only > > > > 1 message > > > > > > > > Thoughts ? > > > > > > > > Enrico > > > > > > > > > > > > > -- > > BR, > > Qiang Huang > > >
