Possible bug? Duplicates when searching kafka stream state store with caching

2018-06-29 Thread Christian Henry
Hi all, I'll first describe a simplified view of relevant parts of our setup (which should be enough to repro), describe the behavior we're seeing, and then note some information I've come across after digging in a bit. We have a kafka stream application, and one of our transform steps keeps a st

Re: Possible bug? Duplicates when searching kafka stream state store with caching

2018-07-02 Thread Christian Henry
is , V> > > So I'd first want to know > > 1) which Kafka version are you using. > 2) why you'd need a window store, and if yes, could you consider using the > single point fetch (added in KAFKA-6560) other than the range query (which > is more expensive as w

Re: Possible bug? Duplicates when searching kafka stream state store with caching

2018-07-03 Thread Christian Henry
m `true`? > > Thanks, > Damian > > On Mon, 2 Jul 2018 at 17:29 Christian Henry > wrote: > > > We're using the latest Kafka (1.1.0). I'd like to note that when we > > encounter duplicates, the window is the same as well. > > > > My original code was a b

Re: Possible bug? Duplicates when searching kafka stream state store with caching

2018-07-06 Thread Christian Henry
Any other ideas here? Should I create a bug? On Tue, Jul 3, 2018 at 1:21 PM, Christian Henry wrote: > Nope, we're setting retainDuplicates to false. > > On Tue, Jul 3, 2018 at 6:55 AM, Damian Guy wrote: > >> Hi, >> >> When you create your window store do