Re: latency related to the checkpointing mode EXACTLY ONCE

2021-02-24 Thread Arvid Heise
M > *To:* Tan, Min ; user > *Subject:* [External] Re: latency related to the checkpointing mode > EXACTLY ONCE > > > > Yes, if you are only reading committed data than it will take least the > checkpoint interval for the data to be available to downstream consumers. > > >

RE: latency related to the checkpointing mode EXACTLY ONCE

2021-02-19 Thread Tan, Min
] Re: latency related to the checkpointing mode EXACTLY ONCE Yes, if you are only reading committed data than it will take least the checkpoint interval for the data to be available to downstream consumers. On 2/18/2021 6:17 PM, Tan, Min wrote: Hi, We use the checkpointing mode EXACTLY ONCE for

Re: latency related to the checkpointing mode EXACTLY ONCE

2021-02-18 Thread Chesnay Schepler
Yes, if you are only reading committed data than it will take least the checkpoint interval for the data to be available to downstream consumers. On 2/18/2021 6:17 PM, Tan, Min wrote: Hi, We use the checkpointing mode EXACTLY ONCE for some of our flink jobs. I wonder how the chec

latency related to the checkpointing mode EXACTLY ONCE

2021-02-18 Thread Tan, Min
Hi, We use the checkpointing mode EXACTLY ONCE for some of our flink jobs. I wonder how the checkpoint configurations specially its checkpoint interval are related to the end to end latency. We need to setup read_commit true for the kafak consumers. Does this lead a latency from one flink job