Re: UnknownProducerIdException in Kafka streams when enabling exactly once

2018-06-05 Thread Matthias J. Sax
Sorry for late reply. > The source stream contains millions of messages produced over several months. What is the retention time of the output topic? If it is smaller than the message timestamp (that I expect to be multiple month old), on write the data would be delete quitckly, because it's olde

UnknownProducerIdException in Kafka streams when enabling exactly once

2018-04-17 Thread Odin
After enabling exactly once processing on a Kafka streams application, the following error appears in the logs: ERROR o.a.k.s.p.internals.StreamTask - task [0_0] Failed to close producer due to the following error: org.apache.kafka.streams.errors.StreamsException: task [0_0] Abort sending since