Re: Join two kafka topics

Perfect! Thanks a lot for the clarification! Kostas > On May 4, 2017, at 4:37 PM, Tarek khal wrote: > > Hi Kostas, > > Yes, now is solved by the help of Jason. > > Best, > > > > -- > View this message in context: > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Join-

Re: Join two kafka topics

Hi Kostas, Yes, now is solved by the help of Jason. Best, -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Join-two-kafka-topics-tp12954p13006.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: Join two kafka topics

Hi Tarek, This question seems to be a duplicate with your other question “ConnectedStream keyBy issues”, right? I am just asking for clarification. Thanks, Kostas > On May 4, 2017, at 1:41 PM, Tarek khal wrote: > > Hi Aljoscha, > > I tested ConnectedStream and CoFlatMapFunction as you told m

Re: Join two kafka topics

Hi Aljoscha, I tested ConnectedStream and CoFlatMapFunction as you told me but the result is not as I wait. *For the execution:* 1) I added 3 rules on "rules" topic (imei: "01","02,"03") 2) Perform 15 events with different imei but i guess i have problem with "keyby" *Result : *

Re: Join two kafka topics

Hi, You get that by having the two input streams keyed on the same key. Either by doing keyBy() on them individually or by using keyBy() on the ConnectedStream. Best, Aljoscha > On 3. May 2017, at 13:06, Tarek khal-letaief > wrote: > > Hi Aljoscha, > Thanks for reply. > > I opted for the f

Re: Join two kafka topics

Hi Aljoscha, Thanks for reply. I opted for the first solution: to use a connected FlatMap [1] but how i can simulate the while(key) and the equalTo(key) of a "join" because the function gets individual calls to flatMap1 and flatMap2. Best regards, Tarek, -- View this message in context: http:

Re: Join two kafka topics

Hi, Instead of a Join, I would suggest to use a connected FlatMap [1] (or a connected ProcessFunction [2]). The problem with a join is that the rules only “survive” for the length of the window while I suspect that you want them to survive longer than that so that they can be applied to events a

Re: Join two kafka topics to do CEP

Hi Gordon, Thank you for your help, maybe i have not explained well. I have two kafka topics (tracking and rules) and I would like to join "tracking" datastream with "rules" datastream as the data arrives in the "tracking" datastream. Here the result that I expect, but without restarting the Jo

Re: Join two kafka topics to do CEP

Hi, Here is my test but it does not work as data arrives i have to re-run, can  anyone help me please ?  I think you meant to sent some code snippet? Either way, some code snippet would probably help in understanding what you’re trying to achieve :) You mentioned "re-run and no data”, so one thi