That is not available for performance reasons. Broker uses zero-copy
to transfer data from disk to the network on the consumer side. If we
post process data already written to disk before sending it to
consumer, we will lose the performance advantage that we have due to
zero copy.
Thanks,
Neha
On
Thanks for the replay Neha, but that's is end-to-end and I am looking
for a broker-consumer compression.
So:
Producer -> uncompressed -> broker -> compressed -> consumer
Regards
Pablo
2013/4/12 Neha Narkhede :
> Kafka already supports end-to-end compression which means data
> transfer between
Kafka already supports end-to-end compression which means data
transfer between brokers and consumers is compressed. There are two
supported compression codecs - GZIP and Snappy. The latter is lighter
on CPU consumption. See this blog post for comparison -
http://geekmantra.wordpress.com/2013/03/28
