As mentioned, a commit can---from a contract point of view---happen
anytime. Of course, we only commit offsets of records that are fully
processed. As punctuations are independent of records, there is no
guarantee when it will be called though.
Currently, we do the following sequence (but this is
Hi Matthias
Does this mean that an offset can be committed before process or punctuate is
called
Or that it could be called up to 30s after process/punctuate is called?
We would like to do batch writes in punctuate of X amount messages gathered in
process.
If the process or punctuate step fails
Committing is independent of process and/or punctuate.
You can configure your Kafka Streams application commit interval to any
value you like via `commit.interval.ms` parameter (default is 30 seconds).
Thus, there is no guarantee when a commit exactly happens with regard to
calling process and pu
Hi
What is the contract around Processor.process and punctuate.
When will Kafka streams commit the offset
After the process method is called successfully or not until punctuate is
called?
Regards
Toby
