Re: Question about v2 committer guarantees

Thanks for the answers, Fabian! To follow up: *1.* SGTM, thanks! *2.* << If some of the RPCs are delayed or do not reach the manager, the Committer will accumulate committables from multiple checkpoints. >> So does that mean it's possible for the Commiter to commit Committables for checkpointIds=

Re: Question about v2 committer guarantees

Hi Scott, It's great to see further adoption of the Sink V2 architecture. Happy to answer your questions. 1. The sink architecture should ensure that Committer:commit is always called with all committables from a subtask for a given subtaskId.There is an open issue where users have reported a pro

Question about v2 committer guarantees

Hi there, I'm working on developing a new version of the fully open-source Delta-Flink Sink using the Unified Flink Sink V2 APIs and the fully open-source Delta-Kernel library (link for more details about Delta-Kernel). I have a few questions about the API gu