Hi Enric, OperatorCoordinator is a mechanism allowing subtasks of the same operator to communicate with each other and thus unifying the behavior of subtasks running on different machines. It has mainly been used in source operators to distribute source splits. As for watermarks, there are multiple strategies to generate them, and I cannot tell immediately whether some of the strategies rely on SourceCoordinator. You can refer to the following document for these strategies. https://nightlies.apache.org/flink/flink-docs-master/docs/dev/datastream/event-time/generating_watermarks/
You are right that the CheckpointCoordinator is responsible for triggering, monitoring and managing checkpoint barriers. Also here is Flink's detailed description about checkpoints. https://nightlies.apache.org/flink/flink-docs-master/docs/dev/datastream/fault-tolerance/checkpointing/ Best, Yunfeng On Wed, Jul 3, 2024 at 10:55 AM Enric Ott <243816...@qq.com> wrote: > > Hello,Community: > Are watermark and checkpoint barrier just generated by source and > coordinated by OperatorCoordinator/CheckpointCoordinator ? > Any clues appreciated! > > > ------------------ 原始邮件 ------------------ > 发件人: "Enric Ott" <243816...@qq.com>; > 发送时间: 2024年1月25日(星期四) 下午2:54 > 收件人: "user"<user@flink.apache.org>; > 主题: how to get flink accumulated sink record count > > Hi，Team： > I was wondering how to get flink accumulated sink record count(just like the > flink UI displays),any help would be appreciated.
