ok..got it..thanks Manikumar...😀 On Thu, Nov 23, 2017 at 2:58 PM, Manikumar <manikumar.re...@gmail.com> wrote:
> topic-level config "compression.type" takes precedence over producer > compression code. > By default topic-level config "compression.type" is "producer", which means > retain > the original compression codec set by the producer. > > If you set topic-level config "compression.type" to any other compression > code, > then on broker-side, it will recompress the data using topic-level config > "compression.type". > No need to restart broker or clients. Disadvantage with approach is > recompression. > > maybe you can try these settings on a test server. > > On Thu, Nov 23, 2017 at 2:39 PM, Sameer Kumar <sam.kum.w...@gmail.com> > wrote: > > > Ok. So you mean stop all producers, change the compress type for topic at > > runtime and switch the compression type for producers and have them start > > again. > > > > On Thu, Nov 23, 2017 at 12:46 PM, Manikumar <manikumar.re...@gmail.com> > > wrote: > > > > > You can dynamically change topic level configs on brokers. > > > http://kafka.apache.org/documentation.html#topicconfigs > > > > > > On Thu, Nov 23, 2017 at 12:38 PM, Sameer Kumar <sam.kum.w...@gmail.com > > > > > wrote: > > > > > > > I am not too sure if I can have different compression types for both > > > > producer and broker. It has to be same. > > > > > > > > This is possible by stopping all brokers, producers and changing > > values. > > > > But for that broker cluster has to be done. I was looking if there is > > any > > > > way we can do that in a running cluster. > > > > > > > > -Sameer. > > > > > > > > On Wed, Nov 22, 2017 at 7:24 PM, Manikumar < > manikumar.re...@gmail.com> > > > > wrote: > > > > > > > > > You can set topic specific compression type by setting topic level > > > config > > > > > "compression.type" > > > > > another option is change compression type config on producer side. > > > > > > > > > > On Wed, Nov 22, 2017 at 4:56 PM, Sameer Kumar < > > sam.kum.w...@gmail.com> > > > > > wrote: > > > > > > > > > > > Hi, > > > > > > > > > > > > Is it possible to switch from gzip to lz4 at runtime on kafka > > > brokers. > > > > My > > > > > > servers are currently running on gzip, and I want to switch them > to > > > > lz4. > > > > > > > > > > > > > > > > > > > > > > > > -Sameer. > > > > > > > > > > > > > > > > > > > > >
