Re: Kafka Cluster High Produce Time

2019-08-21 Thread Lisheng Wang
Hi Dinesh Maybe you can check "kafka.network:type=RequestMetrics,name=RemoteTimeMs,request=FetchFollower" on all broker to see if there are some broker are lower than others? i think if some followers are busy on replicating, then that metric will be lower since maybe there are many records are w

Re: Kafka Cluster High Produce Time

2019-08-21 Thread Dinesh Kumar
Hi Lisheng, Yes, its RemoteTimeMs, "kafka.network:type=RequestMetrics,name=RemoteTimeMs,request=Produce" Sure, i'll try increasing the number of replica fetchers, other configuration are as suggested by the paper, I was also wondering whether i can track which topic or which specific follower is

Re: Kafka Cluster High Produce Time

2019-08-21 Thread Lisheng Wang
Hi Dinesh Just wanna check if the metrics you called is "RemoteTimeMs" or not? if so, The meaning of "RemoteTimeMs" is the time the request is waiting on a remote client for produce. A high value can imply a slow network connection. that explanation come from "Optimizing Your Apache KafkaTM De

Kafka Cluster High Produce Time

2019-08-21 Thread Dinesh Kumar
Hi, We've a kafka (version 2.0.0) cluster with multiple brokers, and many producers with ack=all, or could be ack=1 (which we don't control), There's increase in produce time from 10ms to ~150ms. With JMX metrics able to see "remote" is taking more time, which i figured are followers. 1. Is ther