Re: [Streaming] join events in last 10 minutes

2015-10-14 Thread Renyi Xiong
Hi TD, The scenario here is to let events from topic1 wait a fixed 10 minutes for events with same key from topic2 to come and left outer join them by the key does the query do what is expected? if not, what is the right way to achieve this? thanks, Renyi. On Tue, Oct 13, 2015 at 5:14 PM, Danie

[Streaming] join events in last 10 minutes

2015-10-13 Thread Daniel Li
We have a scenario that events from three kafka topics sharing the same keys need to be merged. One topic has the master events; most events in other two topics arrive within 10 minutes of master event arrival. Wrote pseudo code below. I'd love to hear your thoughts whether I am on the right track.