Re: ConnectedStream keyby issues

2017-05-19 Thread Tarek khal
If I increase the parallelism operator, I risk losing shared state solution or it has nothing to do. And if it's going to be an advantage, is it limited to what? I am new with this framework I find difficulty in some notions. Best Regards, -- View this message in context: http://apache-flink-

Re: ConnectedStream keyby issues

2017-05-19 Thread Tarek khal
Hello Renjie, Yes, the parallelism is 1. what should i do pls ? Regards, -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/ConnectedStream-keyby-issues-tp12999p13226.html Sent from the Apache Flink User Mailing List archive. mailing list arc

Re: Join two kafka topics

2017-05-04 Thread Tarek khal
Hi Kostas, Yes, now is solved by the help of Jason. Best, -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Join-two-kafka-topics-tp12954p13006.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: ConnectedStream keyby issues

2017-05-04 Thread Tarek khal
Hi Jason, Thank you very much for your help, it solves my problem. Best regards, -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/ConnectedStream-keyby-issues-tp12999p13003.html Sent from the Apache Flink User Mailing List archive. mailing l

ConnectedStream keyby issues

2017-05-04 Thread Tarek khal
Hi , I have two kafka topics (tracking and rules) and I would like to join "tracking" datastream with "rules" datastream as the data arrives in the "tracking" datastream. The problem with a join is that the rules only “survive” for the length of the window while I suspect that i want them to surv

Re: Join two kafka topics

2017-05-04 Thread Tarek khal
Hi Aljoscha, I tested ConnectedStream and CoFlatMapFunction as you told me but the result is not as I wait. *For the execution:* 1) I added 3 rules on "rules" topic (imei: "01","02,"03") 2) Perform 15 events with different imei but i guess i have problem with "keyby" *Result : *

Re: Join two kafka topics

2017-05-03 Thread Tarek khal
Hi Aljoscha, Thanks for reply. I opted for the first solution: to use a connected FlatMap [1] but how i can simulate the while(key) and the equalTo(key) of a "join" because the function gets individual calls to flatMap1 and flatMap2. Best regards, Tarek, -- View this message in context: http:

Join two kafka topics

2017-05-02 Thread Tarek khal
I have two kafka topics (tracking and rules) and I would like to join "tracking" datastream with "rules" datastream as the data arrives in the "tracking" datastream. Here the result that I expect, but without restarting the Job, here I restarted the Job to get this result:

Join two kafka topics

2017-05-02 Thread Tarek khal
I have two kafka topics (tracking and rules) and I would like to join "tracking" datastream with "rules" datastream as the data arrives in the "tracking" datastream. Here the result that I expect, but without restarting the Job, here I restarted the Job to get this result: