RE: Surprising order of events in union of two streams

2016-04-18 Thread Eron Wright
aming-scala/src/main/scala/org/numenta/nupic/flink/streaming/connectors/river/RiverSource.scala#L157 -Eron Wright > From: aljos...@apache.org > Date: Mon, 18 Apr 2016 08:20:11 + > Subject: Re: Surprising order of events in union of two streams > To: dev@flink.apache.org > CC: nam

Re: Surprising order of events in union of two streams

2016-04-18 Thread Aljoscha Krettek
Hi, yes, I'm afraid you need a custom operator for that. (We are working on providing built-in support for this, though) I sketched an Operator that does the sorting and also wrote a quick example that uses it: SortedWindowOperator: https://gist.github.com/aljoscha/6600bc1121b7f8a0f68b89988dd341bd

Re: Surprising order of events in union of two streams

2016-04-15 Thread Gary Verhaegen
Hi Aljoscha, What I'm looking for is an operator that joins two streams together, but keeps the events in timestamp order. What I was trying to do with the window specification comes down to: for each event on that stream, I want to call this function with this event and all of the events that ar

Re: Surprising order of events in union of two streams

2016-04-14 Thread Aljoscha Krettek
Hi, Flink does not make any guarantees about the order of arriving elements except in the case of one-to-one forwarding patterns. That is, only for map/flatMap/filter and such operations will the order in which two successive operations see their elements be the same. Could you please describe in