Kraft setup

Hi Team, Can a Kafka Controller Cluster support multiple Kafka setups like ZooKeeper does (with chroot paths)?" Existing setup: In existing setup we are using single zookeeper setup for multiple kafka setups(8). one ZooKeeper cluster handling multiple Kafka clusters using different paths (/kafka-

How does Kafka write to the pagecache/pagetable ?

Hi devs, I am curious in trying to understand the internals of how Kafka actually writes to disk. I am wondering as to how it writes to the pagecache/pagetable ? >From what I understand, Kafka never writes to the files directly instead it writes to the pagecache and lets the OS do the flush to di

[VOTE] 4.0.0 RC1

Hello Kafka users, developers and client-developers, This is the second candidate for release of Apache Kafka 4.0.0. - This is the first release without Apache Zookeeper - The Next Generation of the Consumer Rebalance Protocol is Generally Available - The Transactions Server-Side Defense (Phase 2

Re: [VOTE] 4.0.0 RC1

We still have two documentation blockers: * https://issues.apache.org/jira/browse/KAFKA-18074 * https://issues.apache.org/jira/browse/KAFKA-18422 They should be resolved by the end of the week. I will update the documentation when they are merged. Best, David On Wed, Mar 5, 2025 at 4:35 PM David

Re: How does Kafka write to the pagecache/pagetable ?

Hi Sreyan, Thanks for the question. The page cache is managed by the OS, so I think it is transparent to Kafka writes, which are to files. Just at a higher abstraction level. Some pointers in code: * LogSegment: https://github.com/apache/kafka/blob/trunk/storage/src/main/java/org/apache/

Re: How does Kafka write to the pagecache/pagetable ?

(Sorry, missing links) -- the appending operation in FileRecords: https://github.com/apache/kafka/blob/56fc8e9d2a04172fd014b89428f1c97da93f4894/clients/src/main/java/org/apache/kafka/common/record/FileRecords.java#L184 Cheers, Guang -- Guang Zhao, NetApp gu...@netapp.com