Re: [DISCUSS] Java 23 Support for 3.9.x

Dear all, It seems the main question is whether we should consider version 3.9 as an LTS release. For example, will we continue with versions like 3.9.1, 3.9.2, ... 3.9.100? If yes, we should backport both KIP-1006 and support for future JDKs. If not, backporting KIP-1006 to 3.9 would be suffici

Re: [DISCUSS] Java 23 Support for 3.9.x

> Has the SecurityManager been fully removed in JDK 23? > What is the effect of running Kafka 3.9.0 with JDK 23? The SecurityManager has been degraded, so by default our users experience an UnsupportedOperationException. They can work-around this by setting a system property. In JRE 24, JEP-486 [1

Re: [DISCUSS] Java 23 Support for 3.9.x

Greg, I have not been following this closely, so apologies for some basic questions. Has the SecurityManager been fully removed in JDK 23? What is the effect of running Kafka 3.9.0 with JDK 23? By "4.0 breaking changes" do you mean changes to our JDK/Scala supported versions, removal or ZK, Kaf

Data Corruption in Netty 4.1.111.Final (Kafka 3.9.0)

With the completion of KAFKA-17046 , the netty version has been upgraded to 4.1.111.Final in Kafka 3.9.0. This netty version has a known issue with data corruption, see netty issue and grpc-java issue <

[DISCUSS] Java 23 Support for 3.9.x

Hi all, Now that 3.9.0 is released and 4.0.x is progressing, I'd like to understand everyone's expectations about the 3.9.x branch, and ask for a specific consensus on Java 23 support. Some context that I think is relevant to the discussion: * KIP-1006 [1] proposes a backwards-compatible strategy

Re: Spread primary and replica of a partition across different zones in AWS

Alright. We were not initially using rack aware strategies. So primary and replica were often spread in the same zone (same rack). We then added rack awareness to the server.properties file and restarted the brokers. But of course the partitions were not spread evenly. Now we will manually spread t

Re: Spread primary and replica of a partition across different zones in AWS

On Wed, Nov 20, 2024 at 11:11 AM Soham Chakraborty wrote: > Fair enough. For one time task, we can probably use some manual work with > sprinkling of automation thrown in. I will look into cruise control. > > Question: now that Kafka knows about "rack" future assignments should > strictly be zone

Re: Spread primary and replica of a partition across different zones in AWS

Fair enough. For one time task, we can probably use some manual work with sprinkling of automation thrown in. I will look into cruise control. Question: now that Kafka knows about "rack" future assignments should strictly be zone aware, is that a correct assessment? IOW, if a partition is thrown o

Re: Spread primary and replica of a partition across different zones in AWS

On Wed, Nov 20, 2024 at 9:15 AM Soham Chakraborty wrote: > > So my goal is to know whether there is any knob by which I can force the > leader and replica to go to different AZs and is there any automated > way/tool to handle this for existing partitions. In other words, I want the > leader and

Spread primary and replica of a partition across different zones in AWS

Hi, I have an even number of kafka brokers running on AWS, across two different AZs. What I am observing is that for all topics, sometimes both the leader and replica of a partition are present in the same AZ. I am looking to spread that across two different AZs. The ReplicationFactor for all topi