Hi Aljoscha, I am assuming you're asking about dropping the flink-connector-kafka-0.10/0.11 modules, right? Or are you talking about removing support for Kafka 0.10/0.11 from the universal connector?
I am in favor of removing flink-connector-kafka-0.10/0.11 in the next release. These modules would still be available in Flink 1.11- as a reference, and could be used with Flink 1.12+ with small or no modifications. To my knowledge, you also use the universal Kafka connector with 0.10 brokers, but there might be a performance penalty if I remember correctly. In general, I find it important to continuously reduce baggage that accumulates over time and this seems like a good opportunity. Best, Konstantin On Tue, Aug 25, 2020 at 4:59 AM Paul Lam <paullin3...@gmail.com> wrote: > Hi Aljoscha, > > I'm lightly leaning towards keeping the 0.10 connector, for Kafka 0.10 > still has a steady user base in my observation. > > But if we drop 0.10 connector, can we ensure the users would be able to > smoothly migrate to 0.11 connector/universal connector? > > If I remember correctly, the universal connector is compatible with 0.10 > brokers, but I want to double check that. > > Best, > Paul Lam > > 2020年8月24日 22:46，Aljoscha Krettek <aljos...@apache.org> 写道： > > Hi all, > > this thought came up on FLINK-17260 [1] but I think it would be a good > idea in general. The issue reminded us that Kafka didn't have an > idempotent/fault-tolerant Producer before Kafka 0.11.0. By now we have had > the "modern" Kafka connector that roughly follows new Kafka releases for a > while and this one supports Kafka cluster versions as far back as 0.10.2.0 > (I believe). > > What are your thoughts on removing support for older Kafka versions? And > yes, I know that we had multiple discussions like this in the past but I'm > trying to gauge the current sentiment. > > I'm cross-posting to the user-ml since this is important for both users > and developers. > > Best, > Aljoscha > > [1] https://issues.apache.org/jira/browse/FLINK-17260 > > > -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk
