; Yun Gao
Subject:Re: Migrating Sink v1 to v2
Yun Gao,
Thank you very much for this.
Do you see this ticked be picked up any time soon?
For a moment I was thinking about trying to take my change with it but I
guessing it would be rather hard without deeper understanding of Flink's
internals
[2] https://lists.apache.org/thread/wzwkqd08qkcmmf5m2xroxpxnzzwfphc9 <
> https://lists.apache.org/thread/wzwkqd08qkcmmf5m2xroxpxnzzwfphc9 >
> --
> From:Krzysztof Chmielewski
> Send Time:2022 Sep. 10 (Sat.) 04:04
> T
roxpxnzzwfphc9 >
--
From:Krzysztof Chmielewski
Send Time:2022 Sep. 10 (Sat.) 04:04
To:dev
Subject:Re: Migrating Sink v1 to v2
It seems that there might be an issue with state recovery or some kind
concurrency issue for GlobalCommitterOp
It seems that there might be an issue with state recovery or some kind
concurrency issue for GlobalCommitterOperator created by SinkV1Adapter
that uses StandardSinkTopologies.addGlobalCommitter method in scenarios
with cluster failover.
I've tried to locate the place where the issue is and from
A small update,
When I change number of Sinks from 3 to 1, test passes.
śr., 7 wrz 2022 o 12:18 Krzysztof Chmielewski <
krzysiek.chmielew...@gmail.com> napisał(a):
> Hi,
> I'm a co-author for opensource Delta-Flink connector hosted on [1].
> The connector was originated for Flink 1.12 and current
Hi,
I'm a co-author for opensource Delta-Flink connector hosted on [1].
The connector was originated for Flink 1.12 and currently we migrated to
1.14.
Both sink and source are using new Unified API from Flink 1.12.
I'm evaluating migration to Flink 1.15 where Sink v1 was marked as
deprecated.
Afte
