Re: Window on stream with timestamps ascending by key

2016-03-24 Thread Stephan Ewen
InputStreamOperator ? I'm not sure if I should play with watermarks here > or build a similar concept. How is that different from implementing the > logic inside a FlatMap operator ? > > Regards, > CAM > > > > -- > View this message in context: > http://apache-flink-use

Re: Window on stream with timestamps ascending by key

2016-03-24 Thread cam
concept. How is that different from implementing the logic inside a FlatMap operator ? Regards, CAM -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Window-on-stream-with-timestamps-ascending-by-key-tp5598p5745.html Sent from the Apache Fli

Window on stream with timestamps ascending by key

2016-03-20 Thread Charles-Antoine Mathieu
I wonder how to work with a stream with event timestamps ascending by key. I can have a huge time skew between different keys, for example if I (re)connect an event producer, it will send all buffered results possibly from the last days. Is it possible to trigger the window computation per key

Re: Window on stream with timestamps ascending by key

2016-03-19 Thread Aljoscha Krettek
Hi, what you essentially would require is watermarks that are tracked by key. Right now this is not possible in Flink. The watermarks, which are used for keeping track of the timestamps, are global across all keys. Maybe you could implement something that fits your requirements in a custom oper