topic-level config "compression.type" takes precedence over producer compression code. By default topic-level config "compression.type" is "producer", which means retain the original compression codec set by the producer.
If you set topic-level config "compression.type" to any other compression code, then on broker-side, it will recompress the data using topic-level config "compression.type". No need to restart broker or clients. Disadvantage with approach is recompression. maybe you can try these settings on a test server. On Thu, Nov 23, 2017 at 2:39 PM, Sameer Kumar <sam.kum.w...@gmail.com> wrote: > Ok. So you mean stop all producers, change the compress type for topic at > runtime and switch the compression type for producers and have them start > again. > > On Thu, Nov 23, 2017 at 12:46 PM, Manikumar <manikumar.re...@gmail.com> > wrote: > > > You can dynamically change topic level configs on brokers. > > http://kafka.apache.org/documentation.html#topicconfigs > > > > On Thu, Nov 23, 2017 at 12:38 PM, Sameer Kumar <sam.kum.w...@gmail.com> > > wrote: > > > > > I am not too sure if I can have different compression types for both > > > producer and broker. It has to be same. > > > > > > This is possible by stopping all brokers, producers and changing > values. > > > But for that broker cluster has to be done. I was looking if there is > any > > > way we can do that in a running cluster. > > > > > > -Sameer. > > > > > > On Wed, Nov 22, 2017 at 7:24 PM, Manikumar <manikumar.re...@gmail.com> > > > wrote: > > > > > > > You can set topic specific compression type by setting topic level > > config > > > > "compression.type" > > > > another option is change compression type config on producer side. > > > > > > > > On Wed, Nov 22, 2017 at 4:56 PM, Sameer Kumar < > sam.kum.w...@gmail.com> > > > > wrote: > > > > > > > > > Hi, > > > > > > > > > > Is it possible to switch from gzip to lz4 at runtime on kafka > > brokers. > > > My > > > > > servers are currently running on gzip, and I want to switch them to > > > lz4. > > > > > > > > > > > > > > > > > > > > -Sameer. > > > > > > > > > > > > > > >
