Hi Elias, Please see KIP-31:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-31+-+Move+to+relative+offsets+in+compressed+message+sets With regards to broker compression performance, the following is also relevant: http://www.confluent.io/blog/compression-in-apache-kafka-is-now-34-percent-faster Ismael On Sun, Jan 24, 2016 at 1:21 AM, Elias Levy <fearsome.lucid...@gmail.com> wrote: > I have across this > <http://nehanarkhede.com/2013/03/28/compression-in-kafka-gzip-or-snappy/> > blog > post by Neha Narkhede from a three years ago discussing changes made in > Kafka 0.8 as a result of the introduction of logical message offsets where > the broker has to decompress and recompress compressed messages sent by a > producer. I am wondering if that behavior it still the norm. I.e. is the > broker still decompressing compressed messages and compressing them again? > > Elias >
