Dear Flink devs, I'd like to initiate three(!) Kafka connector releases. The main reason for having three releases is that we have been slacking a bit in keeping up with the latest changes.
Here is the summary: 1. Release kafka-3.3.0 targeting 1.19 and 1.20 (asap) - Incorporates lots of deprecations for Flink 2 including everything that is related to FlinkKafkaProducer (SinkFunction, FlinkKafkaConsumer (SourceFunction), and KafkaShuffle - Lots of bugfixes that are very relevant for 1.19 users (and probably work with older releases) 2. Release kafka-3.4.0 targeting 1.20 (~1-2 weeks later) - Incorporates lineage tracing which is only available in 1.20 [1] (FLIP incorrectly says that it's avail in 1.19) - We have discussed some alternatives to this release in [2] but basically having a separate release is the cleanest solution. - I'd like to linearize the releases to avoid having to do back or even forward ports 3. Release kafka-4.0.0 targeting 2.0-preview (~1-2 weeks later) - Much requested to get the connector out asap for the preview. (I think the old jar using the removed interfaces should still work) - Remove all deprecated things - General spring cleaning (trying to get rid of arch unit violations, migrate to JUnit5) - Should we relocate the TableAPI stuff to o.a.f.connectors? I'd appreciate any feedback and volunteers for RM ;) If you have pending PRs that should be part of any of those releases, please also write them. Best, Arvid [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-314%3A+Support+Customized+Job+Lineage+Listener [1] https://github.com/apache/flink-connector-kafka/pull/111#issuecomment-2306382878
