Hi Mingyu, > it is a different dimension from router implementation
The permission control mechanism won't work without a new router. > The control here is only from the perspective of operation and maintenance to > reduce the impact of accumulated messages on new messages. I think developers should also be aware of this operation, as it will affect message order. > Adding the implementation of the router can also play this role, but it > cannot be dynamically adjusted. So maybe you need a dynamic control to enable this new router in the client (if it's a new type of router)? Thanks, Haiting On Wed, Sep 14, 2022 at 9:37 AM Mingyu Bao <baomin...@apache.org> wrote: > > Hi Haiting, > Permission control is a basic capability based on the existing production and > consumption capabilities, and it is a different dimension from router > implementation. The control here is only from the perspective of operation > and maintenance to reduce the impact of accumulated messages on new messages. > Adding the implementation of the router can also play this role, but it > cannot be dynamically adjusted. > > On 2022/09/13 04:54:45 Haiting Jiang wrote: > > Hi Minyu, > > > > > Yes ,it is a new message router using partition permission without the > > > partition key . > > > > We need to discuss if the new partition permission is absolutely necessary. > > From your use case, you can just implement your router based on the > > backlog. No new feature needs to be added. > > > > So do you have any other use case that can support this partition > > permission? > > > > Thanks, > > Haiting > > > > On Fri, Sep 9, 2022 at 4:15 PM baomingyu <baomingy...@163.com> wrote: > > > > > > Yes ,it is a new message router using partition permission without the > > > partition key . > > > > > > On 2022/08/29 01:43:20 PengHui Li wrote: > > > > Does it look like a new message router for the case that the message is > > > > without the partition key? > > > > The only difference is the router is based on the backlog. > > > > > > > > Thanks, > > > > Penghui > > > > > > > > On Fri, Aug 26, 2022 at 10:15 AM Haiting Jiang <ji...@gmail.com> > > > > wrote: > > > > > > > > > Hi Mingyu, > > > > > > > > > > About the use case of this feature, I have some concerns. > > > > > > > > > > Changing the message routing strategy in the producer may cause a > > > > > message > > > > > ordering issue. > > > > > But if you don't have message ordering requirements, you can use > > > > > SHARE > > > > > subscription mode, > > > > > and we can increase the consumer number of one partition to increase > > > > > the > > > > > consumption rate. > > > > > > > > > > > > > > > Thanks, > > > > > Haiting > > > > > > > > > > On Thu, Aug 25, 2022 at 1:35 PM Gavin Gao <zh...@apache.org> wrote: > > > > > > > > > > > Where we store the metadata? > > > > > > I suggest we use the system topic to store the metadata instead of > > > > > > zk > > > > > > > > > > > > On 2022/08/25 02:36:56 baomingyu_5 wrote: > > > > > > > Hi all, > > > > > > > > > > > > > > In the exclusive consumption mode of exclusive, failover, reader, > > > > > > > etc. > > > > > > if a large number of messages accumulate due to limited consumption > > > > > > capacity or consumption logic problems, expanding partitions or > > > > > > modifying > > > > > > consumption logic cannot reduce the consumption of new messages in > > > > > > time. > > > > > > Influence, a certain proportion of newly added messages will still > > > > > > be > > > > > > produced in the accumulated paritition, and new messages cannot be > > > > > quickly > > > > > > consumed by restarted consumers or new consumers. In this way, the > > > > > > time > > > > > > affected by the accumulation factor may very long. > > > > > > > > > > > > > > In order to reduce the impact on the business, through the > > > > > > > control of > > > > > > read and write permissions, configure some partitions as read-only, > > > > > > so > > > > > that > > > > > > newly produced messages can be sent to the partitions with less > > > > > > accumulation or newly expanded, reducing the impact on the business > > > > > caused > > > > > > by the accumulation of messages. Reduce the overall time-consuming > > > > > > of > > > > > > production--consumption. > > > > > > > > > > > > > > > > >
