[ https://issues.apache.org/jira/browse/KAFKA-1546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14389322#comment-14389322 ]
Jun Rao commented on KAFKA-1546: -------------------------------- For the doc change, do we need to make the following changes? We didn't remove the MaxLag jmx, right? - <td>Max lag in messages btw follower and leader replicas</td> - <td>kafka.server:type=ReplicaFetcherManager,name=MaxLag,clientId=Replica</td> - <td>< replica.lag.max.messages</td> - </tr> - <tr> - <td>Lag in messages per follower replica</td> - <td>kafka.server:type=FetcherLagMetrics,name=ConsumerLag,clientId=([-.\w]+),topic=([-.\w]+),partition=([0-9]+)</td> - <td>< replica.lag.max.messages</td> - </tr> - <tr> <td>Requests waiting in the producer purgatory</td> > Automate replica lag tuning > --------------------------- > > Key: KAFKA-1546 > URL: https://issues.apache.org/jira/browse/KAFKA-1546 > Project: Kafka > Issue Type: Improvement > Components: replication > Affects Versions: 0.8.0, 0.8.1, 0.8.1.1 > Reporter: Neha Narkhede > Assignee: Aditya Auradkar > Labels: newbie++ > Fix For: 0.8.3 > > Attachments: KAFKA-1546.patch, KAFKA-1546_2015-03-11_18:48:09.patch, > KAFKA-1546_2015-03-12_13:42:01.patch, KAFKA-1546_2015-03-16_11:31:39.patch, > KAFKA-1546_2015-03-17_14:46:10.patch, KAFKA-1546_2015-03-25_13:27:40.patch, > KAFKA-1546_2015-03-26_17:44:08.patch, KAFKA-1546_2015-03-27_11:57:56.patch, > documentation.diff > > > Currently, there is no good way to tune the replica lag configs to > automatically account for high and low volume topics on the same cluster. > For the low-volume topic it will take a very long time to detect a lagging > replica, and for the high-volume topic it will have false-positives. > One approach to making this easier would be to have the configuration > be something like replica.lag.max.ms and translate this into a number > of messages dynamically based on the throughput of the partition. -- This message was sent by Atlassian JIRA (v6.3.4#6332)