Re: aggregate stream of logs

2018-01-09 Thread Gary Yao
Hi, First of all, your question is more suited for the Flink user mailing list (this is the dev mailing list). I think you can use a GlobalWindow [1] with a custom trigger. A global window assigns all elements with the same key to the same window, and will not perform any computation unless trigg

aggregate stream of logs

2018-01-08 Thread miki haiat
Hi , i have this scenario of applications that streaming logs to kafka . I want to use flink in order to aggregate the stream and calculate some data i have a guid that i can correlate the stream to single event and i have a field that i can use to understand if is the last stream of the event