Re: Register processing time timers when Operator.close() is called

to finally address this in Flink as well. > > Best, > Aljoscha > > > On 11.11.20 01:02, Boyuan Zhang wrote: > > Hi team, > > > > I'm writing my custom Operator as a high fan-out operation and I use > > processing time timers to defer processing some inputs

Register processing time timers when Operator.close() is called

Hi team, I'm writing my custom Operator as a high fan-out operation and I use processing time timers to defer processing some inputs When timers are firing, the operator will continue to process the deferred elements. One typical use case for my Operator is like: ImpulseOperator -> my Operator ->

Re: How to clean up resources in a UDF?

] https://cwiki.apache.org/confluence/x/4i94CQ > [2] https://cwiki.apache.org/confluence/x/KEJ4CQ > > On 01.10.20 20:35, Boyuan Zhang wrote: > > Thanks, Aljoscha! That's really helpful. > > > > I think I only want to do my cleanup when the task successfully finishes, > &

Re: How to clean up resources in a UDF?

ll do backtracking upwards from the failed > task(s) to see if intermediate results from previous tasks are still > available. If they are available, computation can restart from there. > Otherwise the whole job will have to be restarted. > > Best, > Aljoscha > > On 28.09.20 2

How to clean up resources in a UDF?

Hi team, I'm building a UDF by implementing AbstractRichFunction, where I want to do some resource cleanup per input element when the processing result is committed. I can perform such cleanup in streaming by implementing *CheckpointListener.notifyCheckpointComplete() *but it seems like there is n