Dear Flink devs,

I'd like to initiate three(!) Kafka connector releases. The main reason for
having three releases is that we have been slacking a bit in keeping up
with the latest changes.

Here is the summary:
1. Release kafka-3.3.0 targeting 1.19 and 1.20 (asap)
- Incorporates lots of deprecations for Flink 2 including everything that
is related to FlinkKafkaProducer (SinkFunction, FlinkKafkaConsumer
(SourceFunction), and KafkaShuffle
- Lots of bugfixes that are very relevant for 1.19 users (and probably work
with older releases)

2. Release kafka-3.4.0 targeting 1.20 (~1-2 weeks later)
- Incorporates lineage tracing which is only available in 1.20 [1] (FLIP
incorrectly says that it's avail in 1.19)
- We have discussed some alternatives to this release in [2] but basically
having a separate release is the cleanest solution.
- I'd like to linearize the releases to avoid having to do back or even
forward ports

3. Release kafka-4.0.0 targeting 2.0-preview (~1-2 weeks later)
- Much requested to get the connector out asap for the preview. (I think
the old jar using the removed interfaces should still work)
- Remove all deprecated things
- General spring cleaning (trying to get rid of arch unit violations,
migrate to JUnit5)
- Should we relocate the TableAPI stuff to o.a.f.connectors?

I'd appreciate any feedback and volunteers for RM ;) If you have pending
PRs that should be part of any of those releases, please also write them.

Best,

Arvid

[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-314%3A+Support+Customized+Job+Lineage+Listener
[1]
https://github.com/apache/flink-connector-kafka/pull/111#issuecomment-2306382878

Reply via email to