Re: Is the order guaranteed with Windowall

2019-02-04 Thread morin . david . bzh
ok great. Thanks ! On 2019/02/04 18:00:16, Fabian Hueske wrote: > Yes, I think that should work. > > Best, Fabian > > Am Mo., 4. Feb. 2019 um 18:35 Uhr schrieb morin.david@gmail.com < > morin.david@gmail.com>: > > > Hello Fabian, > > > > Thanks ! > > According to your answers on this

Re: Is the order guaranteed with Windowall

2019-02-04 Thread Fabian Hueske
Yes, I think that should work. Best, Fabian Am Mo., 4. Feb. 2019 um 18:35 Uhr schrieb morin.david@gmail.com < morin.david@gmail.com>: > Hello Fabian, > > Thanks ! > According to your answers on this post > https://stackoverflow.com/questions/50340107/order-of-events-with-chained-keyby-ca

Re: Is the order guaranteed with Windowall

2019-02-04 Thread morin . david . bzh
Hello Fabian, Thanks ! According to your answers on this post https://stackoverflow.com/questions/50340107/order-of-events-with-chained-keyby-calls-on-same-key, if I'm right I can use my sort function followed by a keyby and use a Window for aggregate these events. And the order will be preser

Re: Is the order guaranteed with Windowall

2019-02-04 Thread Fabian Hueske
Hi, A WindowAll is executed in a single task. If you sort the data before the window, the sorting must also happen in a single task, i.e., with parallelism 1. The reasons is that an operator somewhat randomly merges multiple input partitions. So even if each input partition is sorted, the merging

Is the order guaranteed with Windowall

2019-02-02 Thread morin . david . bzh
Hello, I use Watermarks and a function to sort events at the end of my pipeline. I've used this tutorial to sort my data: https://training.da-platform.com/exercises/carSort.html SingleOutputStreamOperator sortStream = streamKeyed.process(new SortEventFunction()).. Then I want to apply a Window