Hi Josep, Thanks for managing the 3.8 release. I have a request: could you please move the KIP-390 into the 3.9 release?
Here is the background: KIP-390 was adopted first but hasn't been released for a long time. After some time, I proposed KIP-780 with further improvements and also corrected an obvious design error (`compression.level` → `compression.(gzip|lz4|zstd). level`), but it hasn't been adopted due to the community's lack of response, my changing job, focusing the in-house fork, etc. And last weekend, I found that KIP-380 has been included in the 3.8 release plan. - KIP-390: https://cwiki.apache.org/confluence/display/KAFKA/KIP-390%3A+Support+Compression+Level - KIP-780: https://cwiki.apache.org/confluence/display/KAFKA/KIP-780%3A+Support+fine-grained+compression+options However, shipping those two features at once has the following benefits: 1. Full functionality without design error. We can provide full functionality, particularly useful with tiered storage feature at once. I found that several users of tiered storage use server-side recompression and want to improve the compression efficiency. Of course, it does not include any design errors :) 2. More chance of testing. Currently, I am managing an in-house fork of Apache Kafka and Cruise Control[^1], running on thousands of clusters on k8s. With our ongoing work on the tiered storage plugin, we can test both KIPs at once. Since we are planning to move the terabytes of logs from thousands of microservices into the object storage, some of them can be ideal testbeds. If you are okay, I will re-initiate the discussion of KIP-780 and rework KIP-380 on the latest trunk. Thanks, Dongjin [^1]: For example: https://github.com/linkedin/cruise-control/pull/2145 On Mon, Feb 26, 2024 at 8:38 PM Josep Prat <josep.p...@aiven.io.invalid> wrote: > Hi all, > > I'd like to volunteer as release manager for the Apache Kafka 3.8.0 > release. > If there are no objections, I'll start building a release plan (or adapting > the one Colin made some weeks ago) in the wiki in the next days. > > Thank you. > > -- > [image: Aiven] <https://www.aiven.io> > > *Josep Prat* > Open Source Engineering Director, *Aiven* > josep.p...@aiven.io | +491715557497 > aiven.io <https://www.aiven.io> | <https://www.facebook.com/aivencloud > > > <https://www.linkedin.com/company/aiven/> < > https://twitter.com/aiven_io> > *Aiven Deutschland GmbH* > Alexanderufer 3-7, 10117 Berlin > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen > Amtsgericht Charlottenburg, HRB 209739 B > -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573159/>github.com/dongjinleekr <https://github.com/dongjinleekr>keybase: https://keybase.io/dongjinleekr <https://keybase.io/dongjinleekr>linkedin: kr.linkedin.com/in/dongjinleekr <https://kr.linkedin.com/in/dongjinleekr>speakerdeck: speakerdeck.com/dongjin <https://speakerdeck.com/dongjin>*
