Re: Issues with Event Time and Kafka

2017-03-07 Thread ext.mwalker
to see how > many rows leave the source, how many enter/leave the window operators, etc? > > That should help figuring out why there are so few result rows... > > Stephan > > > On Mon, Mar 6, 2017 at 8:57 PM, ext.mwalker <[hidden email] > <http:///user/SendEmail.

Issues with Event Time and Kafka

2017-03-06 Thread ext.mwalker
Hi Folks, We are working on a Flink job to proccess a large amount of data coming in from a Kafka stream. We selected Flink because the data is sometimes out of order or late, and we need to roll up the data into 30-minutes event time windows, after which we are writing it back out to an s3 bucke