Thanks for the KIP, this is helpful. A few questions: 1. Have we considered whether we want to allow a similar topic config? 2. Can we rely on a method from the library to pick the default compression level if compression.level is not set? We do it for gzip and it would seem reasonable to do something similar for the other compression libraries. 3. Do we want to allow the buffer/block size to be configurable? This has an impact on memory usage and people may want to trade compression for less/more memory in some cases. For example, the default for LZ4 is 64KB which is a bit high.
Ismael On Sun, Nov 18, 2018, 2:07 PM Dongjin Lee <dong...@apache.org wrote: > Hello dev, > > I hope to initiate the discussion of KIP-390: Add producer option to adjust > compression level > < > https://cwiki.apache.org/confluence/display/KAFKA/KIP-390%3A+Add+producer+option+to+adjust+compression+level > >. > All feedbacks will be highly appreciated. > > Best, > Dongjin > > -- > *Dongjin Lee* > > *A hitchhiker in the mathematical world.* > > *github: <http://goog_969573159/>github.com/dongjinleekr > <http://github.com/dongjinleekr>linkedin: kr.linkedin.com/in/dongjinleekr > <http://kr.linkedin.com/in/dongjinleekr>slideshare: > www.slideshare.net/dongjinleekr > <http://www.slideshare.net/dongjinleekr>* >
