Hi Dongjin, Looking forward to your thoughts.
Best, Maros Orsak On 2025/07/25 07:10:41 Maroš Orsák wrote: > Hi Dongjin, > > Hi Kafka devs, > > Thanks a lot for opening this KIP — and hats off for the amount of > benchmarking and investigation you’ve done! It’s great to see a follow-up > to KIP-390 that digs deeper into these compression-level options with solid > data to back it. > > One thing I wanted to clarify: what specific compression options are we > targeting here? From what I saw in the related PR [1], it seems we’re > mostly exposing block and window sizes. But many codecs expose more than > that: > > > - > > *GZIP* has options like strategy, window size, and buffer size > - > > *LZ4* supports block size (64KB–4MB), block mode (independent vs > linked), checksums, and dictionaries > - > > *Snappy,* as far as I know, doesn’t expose much for tuning > > - > > *ZSTD* has a huge set: threading, window size, block size, dictionaries, > long-distance matching, checksums, etc. It’s a beast in terms of > configurability 😄 > > So I’m curious — is the intent of this KIP to eventually support a broader > set of codec-specific settings, or are we intentionally scoping it down to > just block/window size for now? > > Also, just to check — are you still interested in implementing this KIP > (i.e., KIP-780)? If not, would you be open to me taking it over or helping > move it forward? Of course, only if that works for you — I’d be happy to > coordinate if there’s still interest in pursuing this. > > Looking forward to your thoughts! > > Best, > > Maros Orsak > > [1] - https://github.com/apache/kafka/pull/11388/files >
