Re: Best practice for upgrading Kafka cluster from 0.8.1 to 0.8.1.1

2014-12-04 Thread Yu Yang
Thanks, Guozhang! On Thu, Dec 4, 2014 at 9:08 AM, Guozhang Wang wrote: > You can still do the in-place upgrade, and the logs on the broker will be > then mixed with uncompressed and compressed messages. This is fine also > since the consumers are able to de-compress dynamically based on the > me

Re: Best practice for upgrading Kafka cluster from 0.8.1 to 0.8.1.1

2014-12-04 Thread Guozhang Wang
You can still do the in-place upgrade, and the logs on the broker will be then mixed with uncompressed and compressed messages. This is fine also since the consumers are able to de-compress dynamically based on the message type when consuming the data. Guozhang On Wed, Dec 3, 2014 at 11:33 AM, Yu

Re: Best practice for upgrading Kafka cluster from 0.8.1 to 0.8.1.1

2014-12-04 Thread Yu Yang
Guozhang, We haven't enable message compression yet. In this case, what shall we do when we upgrade to 0.8.2? Must we launch a new cluster, redirect the traffic to the new cluster, and turn off the old one? Thanks! -Yu On Tue, Dec 2, 2014 at 4:33 PM, Guozhang Wang wrote: > Yu, > > Are you e

Re: Best practice for upgrading Kafka cluster from 0.8.1 to 0.8.1.1

2014-12-02 Thread Guozhang Wang
Yu, Are you enabling message compression in 0.8.1 now? If you have already then upgrading to 0.8.2 will not change its behavior. Guozhang On Tue, Dec 2, 2014 at 4:21 PM, Yu Yang wrote: > Hi Neha, > > Thanks for the reply! We know that Kafka 0.8.2 will be released soon. If > we want to upgrade

Re: Best practice for upgrading Kafka cluster from 0.8.1 to 0.8.1.1

2014-12-02 Thread Yu Yang
Hi Neha, Thanks for the reply! We know that Kafka 0.8.2 will be released soon. If we want to upgrade to Kafka 0.8.2 and enable message compression, will we still be able do this in the same way, or we need to handle it differently? Thanks! Regards, -Yu On Tue, Dec 2, 2014 at 3:11 PM, Neha Nark

Re: Best practice for upgrading Kafka cluster from 0.8.1 to 0.8.1.1

2014-12-02 Thread Neha Narkhede
Will doing one broker at a time by brining the broker down, updating the code, and restarting it be sufficient? Yes this should work for the upgrade. On Mon, Dec 1, 2014 at 10:23 PM, Yu Yang wrote: > Hi, > > We have a kafka cluster that runs Kafka 0.8.1 that we are considering > upgrade to 0.8.