Hello, I am trying to understand the compression.type settings and the growth impact from this. With a compression type (valid) settings, this ensures that the message in the topic stays compressed and has to be decompressed by the consumer.
However, it may be possible that the compression will not happen i.e. NONE if the uncompressed size is the same as compressed. I am trying to use this command to verify: ./kafka-run-class kafka.tools.DumpLogSegments --files <log-dir>/filename.log --print-data-log | grep -iE "compresscodec: NONE" I can see a lot of entries with NONE. But all my producers are writing with compression.type=GZIP. Is this expected? Regards,
