Hi, how will this work with encrypted data in logs if/when KIP-317 gets merged? Encrypted data will be hard to compress, so the analyzer tool might need to acquire the decryption key somewhere measure the compression stats.
On 2020/08/17 20:23:51, "Christopher Beard (BLOOMBERG/ 919 3RD A)" <cbea...@bloomberg.net> wrote: > Hi everyone, > > I would like to start a discussion on KIP-640: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-640%3A+Add+log+compression+analysis+tool > > This KIP outlines a new CLI tool which helps compare how the various > compression types supported by Kafka reduce the size of a log (and therefore > more broadly, of a topic). > > I've put together a PR that might help serve as a starting point for comments > and suggestions. > [WIP] PR: https://github.com/apache/kafka/pull/9193 > > Thanks, > Chris Beard