Re: Submitting watermarks through a Kinesis stream

2016-08-29 Thread Steffen Hausmann
That's just awesome! Thanks, Steffen On August 29, 2016 3:39:52 PM GMT+02:00, Stephan Ewen wrote: >You are thinking too complicated here ;-) because Flink internally >already >does all the logic of monitoring the minimum watermark across stream >partitions. >As long as you match the Flink source

Re: Submitting watermarks through a Kinesis stream

2016-08-29 Thread Stephan Ewen
You are thinking too complicated here ;-) because Flink internally already does all the logic of monitoring the minimum watermark across stream partitions. As long as you match the Flink source parallelism to the number of Kinesis shared, that part is taken care of for you. You only need to publis

Submitting watermarks through a Kinesis stream

2016-08-29 Thread Steffen Hausmann
Hi there, I'm feeding a Flink stream with events from a Kinesis stream and I'm looking for some guidance on how to enable event time in the Flink stream. I've read through the documentation and it seems like I want to add events that carry watermark information to the Kinesis stream and subs