Re: Kafka Stream: State replication seems unpredictable.

2021-05-03 Thread Guozhang Wang
Hello Mohan, Sorry for getting late on the thread. Just to revive your concerns here: if in your topology there's no output at all to any topics (sink topics, changelog topics), then yes the zombie would not be detected; but on the other hand the topology itself is not make any visible changes to

Re: Exceptions in kafka streams

2021-05-03 Thread Guozhang Wang
Hello DInesh, Seems you're still using version 1.0 of Kafka Streams with EOS enabled. Could you try to upgrade to a newer version (2.6+) and see if this issue goes away? On Mon, May 3, 2021 at 8:55 AM Dinesh Raj wrote: > Hi, > > I am getting too many exceptions whenever the kafka streams applic

Scheduler is taking a long time, but % and absolute value

2021-05-03 Thread Doug Whitfield
Hi folks, I would like some help understanding what is going on in the below: [2021-05-03 12:53:26,856] INFO [GroupMetadataManager brokerId=0] Finished loading offsets and group metadata from __consumer_offsets-42 in 1659 milliseconds, of which 1647 milliseconds was spent in the scheduler. (ka

Exceptions in kafka streams

2021-05-03 Thread Dinesh Raj
Hi, I am getting too many exceptions whenever the kafka streams application is scaled out or scaled down. org.apache.kafka.common.errors.InvalidProducerEpochException: Producer > attempted to produce with an old epoch. > Written offsets would not be recorded and no more records would be sent > si