Hi Haiting, Permission control is a basic capability based on the existing production and consumption capabilities, and it is a different dimension from router implementation. The control here is only from the perspective of operation and maintenance to reduce the impact of accumulated messages on new messages. Adding the implementation of the router can also play this role, but it cannot be dynamically adjusted.
On 2022/09/13 04:54:45 Haiting Jiang wrote: > Hi Minyu, > > > Yes ,it is a new message router using partition permission without the > > partition key . > > We need to discuss if the new partition permission is absolutely necessary. > From your use case, you can just implement your router based on the > backlog. No new feature needs to be added. > > So do you have any other use case that can support this partition permission? > > Thanks, > Haiting > > On Fri, Sep 9, 2022 at 4:15 PM baomingyu <baomingy...@163.com> wrote: > > > > Yes ,it is a new message router using partition permission without the > > partition key . > > > > On 2022/08/29 01:43:20 PengHui Li wrote: > > > Does it look like a new message router for the case that the message is > > > without the partition key? > > > The only difference is the router is based on the backlog. > > > > > > Thanks, > > > Penghui > > > > > > On Fri, Aug 26, 2022 at 10:15 AM Haiting Jiang <ji...@gmail.com> > > > wrote: > > > > > > > Hi Mingyu, > > > > > > > > About the use case of this feature, I have some concerns. > > > > > > > > Changing the message routing strategy in the producer may cause a > > > > message > > > > ordering issue. > > > > But if you don't have message ordering requirements, you can use SHARE > > > > subscription mode, > > > > and we can increase the consumer number of one partition to increase the > > > > consumption rate. > > > > > > > > > > > > Thanks, > > > > Haiting > > > > > > > > On Thu, Aug 25, 2022 at 1:35 PM Gavin Gao <zh...@apache.org> wrote: > > > > > > > > > Where we store the metadata? > > > > > I suggest we use the system topic to store the metadata instead of zk > > > > > > > > > > On 2022/08/25 02:36:56 baomingyu_5 wrote: > > > > > > Hi all, > > > > > > > > > > > > In the exclusive consumption mode of exclusive, failover, reader, > > > > > > etc. > > > > > if a large number of messages accumulate due to limited consumption > > > > > capacity or consumption logic problems, expanding partitions or > > > > > modifying > > > > > consumption logic cannot reduce the consumption of new messages in > > > > > time. > > > > > Influence, a certain proportion of newly added messages will still be > > > > > produced in the accumulated paritition, and new messages cannot be > > > > quickly > > > > > consumed by restarted consumers or new consumers. In this way, the > > > > > time > > > > > affected by the accumulation factor may very long. > > > > > > > > > > > > In order to reduce the impact on the business, through the control > > > > > > of > > > > > read and write permissions, configure some partitions as read-only, so > > > > that > > > > > newly produced messages can be sent to the partitions with less > > > > > accumulation or newly expanded, reducing the impact on the business > > > > caused > > > > > by the accumulation of messages. Reduce the overall time-consuming of > > > > > production--consumption. > > > > > > > > > > > > >
