Re: Question about the process order in stream aggregate

2017-04-12 Thread Xingcan Cui
timestamp of "arrival", but it will > > produce sorted output as you "order by rowTime". Hope it helps. > > > > Best, > > Stefano > > > > -Original Message- > > From: Xingcan Cui [mailto:xingc...@gmail.com] > > Sent: Wednesday, Ap

Re: Question about the process order in stream aggregate

2017-04-12 Thread Fabian Hueske
: Xingcan Cui [mailto:xingc...@gmail.com] > Sent: Wednesday, April 12, 2017 8:11 AM > To: dev@flink.apache.org > Subject: Re: Question about the process order in stream aggregate > > Hi everybody, > > thank you all for your help. > > @Fabian I also check the DataStream tha

RE: Question about the process order in stream aggregate

2017-04-12 Thread Stefano Bortoli
Xingcan Cui [mailto:xingc...@gmail.com] Sent: Wednesday, April 12, 2017 8:11 AM To: dev@flink.apache.org Subject: Re: Question about the process order in stream aggregate Hi everybody, thank you all for your help. @Fabian I also check the DataStream that translated from the query and try to figure out

Re: Question about the process order in stream aggregate

2017-04-11 Thread Xingcan Cui
; > The order of records is changed because of the connection between source > and first map function. Here, records are distributed round robin to > increase the parallelism from 1 to n. The parallel instances of map might > forward the records in different order to the ProcessFunction that

RE: Question about the process order in stream aggregate

2017-04-11 Thread Radu Tudoran
: AW: Question about the process order in stream aggregate Resending to dev@f.a.o Hi Xingcan, This is expected behavior. In general, is not possible to guarantee results for processing time. Your query is translated as follows: CollectionSrc(1) -round-robin-> MapFunc(n) -hash-part-> ProcessFu

AW: Question about the process order in stream aggregate

2017-04-11 Thread fhueske
aggregation. Hope this helps, Fabian Von: Stefano Bortoli Gesendet: Dienstag, 11. April 2017 14:10 An: dev@flink.apache.org Betreff: RE: Question about the process order in stream aggregate Hi Xingcan, Are you using parallelism 1 for the test? procTime semantics deals with the objects as they l

RE: Question about the process order in stream aggregate

2017-04-11 Thread Stefano Bortoli
you to have a look at the integration test to verify that the configuration of your experiment is correct. Best, Stefano -Original Message- From: Xingcan Cui [mailto:xingc...@gmail.com] Sent: Tuesday, April 11, 2017 5:31 AM To: dev@flink.apache.org Subject: Question about the process

Question about the process order in stream aggregate

2017-04-10 Thread Xingcan Cui
Hi all, I run some tests for stream aggregation on rows. The data stream is simply registered as val orderA: DataStream[Order] = env.fromCollection(Seq( Order(1L, "beer", 1), Order(2L, "diaper", 2), Order(3L, "diaper", 3), Order(4L, "rubber", 4))) tEnv.registerDataStream("