Re: Register processing time timers when Operator.close() is called

2020-11-11 Thread Boyuan Zhang
Thanks, Aljoscha! Manually draining processing time timers during operator.close() is my current workaround as well. It's just not efficient for me since I may set the processing time timer for the callback after 5 mins but now I need to fire them immediately. https://issues.apache.org/jira/brows

Re: Register processing time timers when Operator.close() is called

2020-11-11 Thread Aljoscha Krettek
Hi! This is an interesting topic and we recently created a Jira issue about this: https://issues.apache.org/jira/browse/FLINK-18647. In Beam we even have a workaround for this: https://github.com/apache/beam/blob/0c01636fc8610414859d946cb93eabc904123fc8/runners/flink/src/main/java/org/apache/

Register processing time timers when Operator.close() is called

2020-11-10 Thread Boyuan Zhang
Hi team, I'm writing my custom Operator as a high fan-out operation and I use processing time timers to defer processing some inputs When timers are firing, the operator will continue to process the deferred elements. One typical use case for my Operator is like: ImpulseOperator -> my Operator ->