Re: KTable aggregate corruption on poorly timed exception

2017-05-23 Thread Mathieu Fenniak
Hi Matthias, I've filed KAFKA-5315 (https://issues.apache.org/jira/browse/KAFKA-5315). Thanks, Mathieu On Fri, May 19, 2017 at 3:07 PM, Matthias J. Sax wrote: > Hi Mathieu, > > Thanks for reporting this! > > This is definitely a bug and it must get fixed for at-last-once > processing, too. Ex

Re: KTable aggregate corruption on poorly timed exception

2017-05-19 Thread Matthias J. Sax
Hi Mathieu, Thanks for reporting this! This is definitely a bug and it must get fixed for at-last-once processing, too. Exactly-once is not required to avoid the bug. Can you open a Jira? I think, I know already how to fix it. -Matthias On 5/19/17 8:53 AM, Mathieu Fenniak wrote: > Whoops, I

KTable aggregate corruption on poorly timed exception

2017-05-19 Thread Mathieu Fenniak
Hi Kafka devs, This morning I observed a specific Kafka Streams aggregation that ended up with an incorrect computed output after a Kafka Streams thread crashed with an unhandled exception. The topology is pretty simple -- a single KTable source, group by a field in the value, aggregate that adds

Re: KTable aggregate corruption on poorly timed exception

2017-05-19 Thread Mathieu Fenniak
Whoops, I said I'd put the specific exception at the bottom of the e-mail. It probably isn't the important part of this thread, but might suggest when this situation can occur. Also of note, this is occurring on Kafka Streams 0.10.2.1. 20:56:07.061 [StreamThread-3] ERROR o.a.k.s.p.internals.Str