Hi, I would like to bring this back to everyone's attention. This KIP introduces a simple framework that enables the use of alternative, faster implementations of the existing compression codecs (Gzip, Snappy, Zstandard and LZ4) in Kafka.
https://cwiki.apache.org/confluence/x/Xgr0Ew Thanks -----Original Message----- From: Denloye, Olasoji <[email protected]> Sent: Thursday, February 13, 2025 1:22 PM To: [email protected] Subject: RE: [DISCUSS] KIP-1121: Compression acceleration in Kafka Hi, I would like to bring this back to everyone's attention. I have made changes to the proposal to incorporate the ServiceLoader API as suggested. https://cwiki.apache.org/confluence/x/Xgr0Ew Thanks -----Original Message----- From: Denloye, Olasoji Sent: Thursday, December 19, 2024 11:01 AM To: [email protected] Subject: RE: [DISCUSS] KIP-1121: Compression acceleration in Kafka Hi Frédérik, Thanks for the suggestion to use the existing ServiceLoader feature in Java. It could serve as suitable mechanism for selecting the best available compression codec. Thanks -----Original Message----- From: Frédérik Rouleau <[email protected]> Sent: Wednesday, December 18, 2024 12:24 AM To: [email protected] Subject: Re: [DISCUSS] KIP-1121: Compression acceleration in Kafka Hi Olasoji, I think that having a way to provide some optimised/accelerated implementation is a good idea. What not using the ServiceLoader feature of Java? That would allow anyone to provide their own optimised implementation depending on their infrastructure. We can keep the existing implementation as the default and allow Kafka to find a better implementation based on Service found. As you mentioned, we might need to enrich the interface to allow Kafka to find the best version available at runtime. Regards, On Tue, Dec 17, 2024 at 6:36 PM Denloye, Olasoji <[email protected]> wrote: > Hi Everyone, > > I would like to start a discussion on KIP-1121: Compression > acceleration acceleration in Kafka. KIP-1121: Compression acceleration > in Kafka - Apache Kafka - Apache Software Foundation< > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1121%3A+Compress > ion+acceleration+in+Kafka > > >
