Re: Flink Checkpoint & Offset Commit

2024-03-07 Thread xia rui
Hi Jacob. Flink uses "notification" to let an operator callback the completion of a checkpoint. After gathering all checkpoint done messages from TMs, JM sends a "notify checkpoint completed" RPC to all TMs. Operators will handle this notification, where checkpoint success callbacks are invoked. F

Re: Question about time-based operators with RocksDB backend

2024-03-06 Thread xia rui
Hi Gabriele, use (or extend) the window operator provided by Flink is a better idea. A window operator in Flink manages two types of state: - Window state: accumlate data for windows, and provide data to window function when a window comes to its end time. - Timer state: store the end tim

Error with Flink-Gelly, lastJobExecutionResult is null for ExecutionEnvironment

2020-07-31 Thread Xia Rui
Hello, everyone. I am trying to use Flink-Gelly. The version of Flink I used is 1.11 (I also tried 1.12, and it does not work as well). Following the instruction in https://ci.apache.org/projects/flink/flink-docs-release-1.11/dev/libs/gelly/ . First, I build my Flink code with: (1) git clo