This sounds like a reasonable solution to me. Thanks, Peter!
On Thu, Jul 18, 2024 at 8:28 AM Steven Wu wrote:
> Regarding unaligned checkpoints, Flink savepoint is always aligned and
> recommended for Flink version upgrade. We can potentially recommend users
> to use Flink savepoint to pick up t
Regarding unaligned checkpoints, Flink savepoint is always aligned and
recommended for Flink version upgrade. We can potentially recommend users
to use Flink savepoint to pick up this fix.
I will take a closer look at the PR.
On Thu, Jul 18, 2024 at 6:22 AM Péter Váry
wrote:
> Hi Team,
>
> Qish
Hi Team,
Qishang Zhong found a bug with Flink Sink [1].
In nutshell:
- Failure during checkpoints could cause duplicate data with Flink sink
with CDC writes
In more detail:
- If there is a failure after the `prepareSnapshotPreBarrier` but before
the `snapshotState` for CHK1, then the data/delete
