Re: Is the order guaranteed with Windowall

2019-02-04 Thread morin . david . bzh
ok great. Thanks ! On 2019/02/04 18:00:16, Fabian Hueske wrote: > Yes, I think that should work. > > Best, Fabian > > Am Mo., 4. Feb. 2019 um 18:35 Uhr schrieb morin.david@gmail.com < > morin.david@gmail.com>: > > > Hello Fabian, > > > > Thanks ! > > According to your answers on this

Re: Is the order guaranteed with Windowall

2019-02-04 Thread morin . david . bzh
Hello Fabian, Thanks ! According to your answers on this post https://stackoverflow.com/questions/50340107/order-of-events-with-chained-keyby-calls-on-same-key, if I'm right I can use my sort function followed by a keyby and use a Window for aggregate these events. And the order will be preser

Is the order guaranteed with Windowall

2019-02-02 Thread morin . david . bzh
Hello, I use Watermarks and a function to sort events at the end of my pipeline. I've used this tutorial to sort my data: https://training.da-platform.com/exercises/carSort.html SingleOutputStreamOperator sortStream = streamKeyed.process(new SortEventFunction()).. Then I want to apply a Window

workaround for kafka idle partition and watermark

2019-01-30 Thread morin . david . bzh
Hello, I've faced to this issue in production: https://issues.apache.org/jira/browse/FLINK-5479 One topic contains idle partition and all pipeline is quite fucked up. I've used aggregation based on these watermarks and the trigger is never launched. is it possible to define a workaround in waiti