Re: KIP-429 vs. KIP 848?

2025-06-16 Thread Brebner, Paul
Sorry error: 429 appeared in Kafka 2.4.0, and 848 appeared in 3.7 Paul From: Brebner, Paul Date: Tuesday, 17 June 2025 at 12:32 pm To: Kafka Users , dev Subject: KIP-429 vs. KIP 848? EXTERNAL EMAIL - USE CAUTION when clicking links or attachments Hi all, time for me to ask a silly

KIP-429 vs. KIP 848?

2025-06-16 Thread Brebner, Paul
Hi all, time for me to ask a silly question please! I'm puzzled about the transition from KIP-429 https://cwiki.apache.org/confluence/display/KAFKA/KIP-429%3A+Kafka+Consumer+Incremental+Rebalance+Protocol to KIP-848 https://cwiki.apache.org/confluence/display/KAFKA/KIP-848%3A+The+Next+Generatio

Re: KafkaProducer partitionsFor v/s KafkaAdminClient describeTopics

2025-06-11 Thread Brebner, Paul
Hi Anana, Typically in Kafka, it is useful for Consumers to know about the number of partitions (as the number of consumers must be <= partitions). So one way for Consumers to find partitions is the KafkaConsumer class using the partitionsFor(topic) method, https://kafka.apache.org/40/javadoc/o

ZK vs KRaft benchmarking - latency differences?

2024-01-31 Thread Brebner, Paul
Hi all, We’ve previously done some benchmarking of Kafka ZooKeeper vs KRaft and found no difference in throughput (which we believed is also what theory predicted, as ZK/Kraft are only involved in Kafka meta-data operations, not data workloads). BUT – latest tests reveal improved producer and

Re: Kafka Cluster WITHOUT Zookeeper

2023-03-28 Thread Brebner, Paul
Kafka 3.5.0. Cheers, David On Mon, Mar 27, 2023 at 6:32 PM Brebner, Paul wrote: > I have a recent 3 part blog series on Kraft (expanded version of ApacheCon > 2022 talk): > > > > > https://www.instaclustr.com/blog/apache-kafka-kraft-abandons-the-zookeeper-part-1-parti

Re: Kafka Cluster WITHOUT Zookeeper

2023-03-27 Thread Brebner, Paul
I have a recent 3 part blog series on Kraft (expanded version of ApacheCon 2022 talk): https://www.instaclustr.com/blog/apache-kafka-kraft-abandons-the-zookeeper-part-1-partitions-and-data-performance/ https://www.instaclustr.com/blog/apache-kafka-kraft-abandons-the-zookeeper-part-2-partitions-an