Re: Use of AggregateFunction's merge() method

2018-05-06 Thread Fabian Hueske
Hi Ken, You are right. The merge() method combines partial aggregates, similar to a combinable reducer. The only situation when merge() is called in a DataStream job (that I am aware of) is when session windows get merged. For example when you define a session window with 30 minute gap and you re

Use of AggregateFunction's merge() method

2018-05-04 Thread Ken Krugler
I’m trying to figure out when/why the AggregateFunction.merge() method is called in a streaming job, to ensure I’ve implemented it properly. The docu