Re: SourceEvent Task Failure Handling

2022-03-02 Thread Qingsheng Ren
Hi Mason, Unfortunately from SplitEnumerator’s aspect, events will be lost if they are not delivered to the SourceReader. On OperatorCoordinator level, if an OperatorEvent is not delivered successfully, the coordinator will trigger a subtask failover, then OperatorCoordinator#subtaskReset wi

SourceEvent Task Failure Handling

2022-02-25 Thread Mason Chen
Hi Devs, I am implementing a custom connector with the FLIP27 interface and I have a question about how source events are handled with respect to task/taskmanager failure. In my implementation, the enumerator sends source events to readers so that readers can react to split changes detected by the