RequestHandlerAvgIdlePercent Metric

2020-08-13 Thread Dhirendra Singh
I have all kafka broker metrics exported to prometheus and trying to build grafana dashboard. Kafka version i am using is 2.5.0 I am confused about kafka.server:type=KafkaRequestHandlerPool,name=RequestHandlerAvgIdlePercent metric. according to kafka documentation it is "The average fraction of tim

Re: will partition reassignment cause same message being processed in parallel?

2020-08-13 Thread Yingshuan Song
Yes,it is possible. Think of this : 1 - Consumer A and consumer B ( A and B with the same consumer group.id and enable auto commit) consume a topic T with 2 partitions,and the assignment is (A => T-0 , B => T-1) 2 - The application runs correctly when the records are sent to kafka at a low sp

Re: Documentation suggestion / issue and question about ticket openning

2020-08-13 Thread Tom Bentley
Hi Ahmed, I have an open PR (https://github.com/apache/kafka/pull/8878) which, although far from being a perfect solution, would be of _some_ help. Some configs are common between broker, producer and consumer and right now it's not possible to link directly to, say, the consumer one because the i