Hi Ria, I think this KIP will be a great addition! My current use case for replication throttling is during broker recovery after data loss; in this situation we would want to throttle the replication of all topics to avoid impacting producer/consumer traffic, which would be much easier with broker-level throttle toggling.
In case you haven't seen, I also raised a KIP (KIP-1051) to allow replication throttle rate to be applied statically. I'm not sure if that's also useful for you. Additionally, I have fixed the bug you mentioned in KIP-1009 (https://issues.apache.org/jira/browse/KAFKA-10190), which allows the throttle rate to be applied across all brokers. Kind regards, Harry On 2023/11/21 20:26:37 "Ria Pradeep (BLOOMBERG/ 919 3RD A)" wrote: > Hi All, > > (I sent the previous email prematurely, apologies) > > I'd like to start a discussion on KIP-1009: Add Broker-level Throttle > Configurations - > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1009%3A+Add+Broker-level+Throttle+Configurations > > At a high level, this KIP adds dynamic broker level configurations to > throttle out of sync replication. Currently, replication throttles can be > configured at a topic level, but not for the broker as a whole. > > I’m looking forward to hearing any suggestions or thoughts on this KIP! > > Thanks, > Ria > > > From: dev@kafka.apache.org At: 11/21/23 15:17:15 UTC-5:00To: > dev@kafka.apache.org > Subject: [DISCUSS] KIP-1009: Add Broker-level Throttle Configurations > > Hi All, > > I'd like to start a discussion on KIP-1009: Add Broker-level Throttle > Configurations. > >
