Yes it will compress the data stored on the file system if you specify compression in the producer. You can check whether the data is compressed on disk by running the following command in the data directory. kafka-run-class kafka.tools.DumpLogSegments --print-data-log --files latest-log-file.log
> On 17 Mar 2016, at 23:59, R P <hadoo...@outlook.com> wrote: > > Hello All, > Does kafka support compressing storage logs stored in log dir? > What does compression.type=(gzip/snappy) in server.properties do? > > Based on documents I am assuming that it will compress the logs on local > file system. > I ran a quick experiment and found that my logs stored on local disk are > not getting compressed. > Size of data stored on disk is same with or without compression. > > I am using following configuration properties in server.properties > config file. > > compression.type=gzip > compressed.topics="gzip-topic" > > Thanks for reading and appreciate any responses. > > Thanks, > R P
