Manish Kumar Sinha created KAFKA-17872:
------------------------------------------

             Summary: Kafka stream job does not commit offset when packets are 
getting ignored intentionally 
                 Key: KAFKA-17872
                 URL: https://issues.apache.org/jira/browse/KAFKA-17872
             Project: Kafka
          Issue Type: Bug
          Components: streams
            Reporter: Manish Kumar Sinha


Hi,

We are using kafka stream to consume messages from one kafka topic.

Due to some business logic, we ignore all the packets before 8am by returning 
{{-1L}} from {{CustomTimestampExtractor}} for all such packets.

We start consuming all the packets after 8am.

Everything is running fine, but consumer lag on my consumer group before 8am 
keeps increasing and goes to 0 after 8am.


{{{}[commit.interval.ms|http://commit.interval.ms/]{}}}{{{}=1000{}}} commit 
interval is set to 1s



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to