Kafka replication throttling on broker level

2019-04-05 Thread Rahul Agarwal (Flipkart Data Group)
Hi, We are using Kafka 1.0.2 and wanted to rate limit when a broker is replaced and it syncs up with other brokers in the cluster. I followed the below doc for the same: https://kafka.apache.org/10/documentation.html#rep-throttle According to this document, leader.replication.throttled.rate, foll

Kafka replication throttling on broker level

2019-04-05 Thread Rahul Agarwal (Flipkart Data Group)
Hi, We are using Kafka 1.0.2 and wanted to rate limit when a broker is replaced and it syncs up with other brokers in the cluster. I followed the below doc for the same: https://kafka.apache.org/10/documentation.html#rep-throttle According to this document, leader.replication.throttled.rate, foll

Re: Kafka replication throttling

2014-05-21 Thread Marcos Juarez Lopez
Thanks for your response Jun. JIRA has been filed (see link below). Please let me know if I should add more details/context: https://issues.apache.org/jira/browse/KAFKA-1464 Thanks, Marcos Juarez On Wed, May 21, 2014 at 8:40 AM, Jun Rao wrote: > We don't have such throttling right now. Co

Re: Kafka replication throttling

2014-05-21 Thread Jun Rao
We don't have such throttling right now. Could you file a jira? Thanks, Jun On Tue, May 20, 2014 at 10:29 PM, Marcos Juarez Lopez wrote: > Hi, > > We have several Kafka clusters in production, and we've had to reassign > replication a few times now in production. Some of our topic/partitions

Kafka replication throttling

2014-05-20 Thread Marcos Juarez Lopez
Hi, We have several Kafka clusters in production, and we've had to reassign replication a few times now in production. Some of our topic/partitions are pretty large, up to 32 partitions per topic, and 16GB per partition, so adding a new broker and/or repairing a broker that had been down for some