Re: Window function - flush on job stop

2022-01-24 Thread Caizhi Weng
Hi! As far as I know there is currently no way to do this. However if you'd like to, you can implement this with a custom source. Before you stop the job you need to send a signal to this custom source (for example through a common file on HDFS or just through socket) and if the custom source dete

Window function - flush on job stop

2022-01-21 Thread Lars Skjærven
We're doing a stream.keyBy().window().aggregate() to aggregate customer feedback into sessions. Every now and then we have to update the job, e.g. change the key, so that we can't easlily continue from the previous state. Cancelling the job (without restarting from last savepoint) will result in l