Re: KStream-KTable join with the KTable given a "head start"

2016-04-01 Thread Guozhang Wang
how Kafka Streams is coordinating stream progress within a topology? > > I'll plan to post a resolution back to the user mailing list once I feel > like I have a reasonable handle on how this works. > > And thank you so much for your help. > > >> >>> On Wed, M

Re: KStream-KTable join with the KTable given a "head start"

2016-03-30 Thread Jeff Klukas
-- Forwarded message -- > From: Jeff Klukas > To: users@kafka.apache.org > Cc: > Date: Wed, 30 Mar 2016 11:14:53 -0400 > Subject: KStream-KTable join with the KTable given a "head start" > I have a KStream that I want to enrich with some values from

Re: KStream-KTable join with the KTable given a "head start"

2016-03-30 Thread Guozhang Wang
Hi Jeff, This is a common case of stream-table join, in that the joining results depending on the arrival ordering from these two sources. In Kafka Streams you can try to "synchronize" multiple input streams through the "TimestampExtractor" interface, which is used to assign a timestamp to each r

KStream-KTable join with the KTable given a "head start"

2016-03-30 Thread Jeff Klukas
I have a KStream that I want to enrich with some values from a lookup table. When a new key enters the KStream, there's likely to be a corresponding entry arriving on the KStream at the same time, so we end up with a race condition. If the KTable record arrives first, then its value is available fo