Huge latency at consumer side ,testing performance for production and consumption

2021-12-12 Thread Jigar Shah
Hello, I am trying to test the latency between message production and message consumption using Java Kafka-Client*(2.7.2)* library. The configuration of cluster is 3 KafkaBrokers*(2.7.2, Scala 2.13)*, 3 Zookeeper*(3.5.9)* Here is a pattern what I have observed Reference: ConsumerReadTimeStamp: Ti

Re: Huge latency at consumer side ,testing performance for production and consumption

2021-12-12 Thread Liam Clarke-Hutchinson
Hi, I'm assuming you're using consumer groups? E.g., group.id=X Cheers, Liam On Mon, 13 Dec 2021, 6:30 pm Jigar Shah, wrote: > Hello, > I am trying to test the latency between message production and message > consumption using Java Kafka-Client*(2.7.2)* library. > The configuration of cluster

Re: Huge latency at consumer side ,testing performance for production and consumption

2021-12-12 Thread Liam Clarke-Hutchinson
I realise that's a silly question, you must be if you're using auto commit. When a consumer starts, it needs to do a few things. 1) Connect to a bootstrap server 2) Join an existing consumer group, or create a new one, if it doesn't exist. This may cause a stop the world rebalance as partitions