Matthias J. Sax created KAFKA-6607:
--------------------------------------
Summary: Kafka Streams lag not zero when input topic transactional
Key: KAFKA-6607
URL: https://issues.apache.org/jira/browse/KAFKA-6607
Project: Kafka
Issue Type: Improvement
Components: streams
Affects Versions: 1.0.0
Reporter: Matthias J. Sax
When an input topic for a Kafka Streams application is written using
transaction, Kafka Streams does not commit "endOffset" but "endOffset - 1" if
it reaches the end of topic. The reason is the commit marker that is the last
"message" in the topic; Streams commit "offset of last processed message plus
1" and does not take commit markers into account.
This is not a correctness issue, but when one inspect the consumer lag via
{{bin/kafka-consumer.group.sh}} the lag is show as 1 instead of 0 – what is
correct from consumer-group tool point of view.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
