Re: Steps & best-practices to upgrade Confluent Kafka 4.1x to 5.3x

2020-09-01 Thread Rijo Roy
Hi, So, I started testing the steps suggested above to upgrade Kafka-Zk clusters with confluent-kafka-2.12 which will install v5.5.1 and was able to perform a rolling upgrade of Kafka clusters in a test env. And they are currently running with "inter.broker.protocol.version=1.1". Before I swit

Re: Steps & best-practices to upgrade Confluent Kafka 4.1x to 5.3x

2020-08-19 Thread Rijo Roy
Sure Manoj! Really appreciate your quick response.. On 2020/08/19 17:40:54, wrote: > Great . > Share your finding to this group once you done upgrade Confluent Kafka 4.1x > to 5.3x successfully . > > I see many people having same question here . > > On 8/19/20, 10:38 AM, "Rijo Roy" wrot

Re: Steps & best-practices to upgrade Confluent Kafka 4.1x to 5.3x

2020-08-19 Thread Manoj.Agrawal2
Great . Share your finding to this group once you done upgrade Confluent Kafka 4.1x to 5.3x successfully . I see many people having same question here . On 8/19/20, 10:38 AM, "Rijo Roy" wrote: [External] Thanks Manoj! Yeah, the plan is to start with non-prod and validate fir

Re: Steps & best-practices to upgrade Confluent Kafka 4.1x to 5.3x

2020-08-19 Thread Rijo Roy
Thanks Manoj! Yeah, the plan is to start with non-prod and validate first before going to prod. Thanks & Regards, Rijo Roy On 2020/08/19 17:33:53, wrote: > I advise to do it non-prod for validation . > You can backup data log folder if you want but I have'nt see any issue . but > better to b

Re: Steps & best-practices to upgrade Confluent Kafka 4.1x to 5.3x

2020-08-19 Thread Manoj.Agrawal2
I advise to do it non-prod for validation . You can backup data log folder if you want but I have'nt see any issue . but better to backup data if it small . Don’t change below value to latest until you done full validation , once you changed to latest then you can't rollback . inter.broker.pro

Re: Steps & best-practices to upgrade Confluent Kafka 4.1x to 5.3x

2020-08-19 Thread Rijo Roy
Thanks Manoj! Appreciate your help.. I will follow the steps you pointed out.. Do you think there is a need to : 1. backup the data before the rolling upgrade 2. some kind of datasync that should be considered here.. I don't think this is required as I am performing an in-place upgrade.. Thank

Re: Steps & best-practices to upgrade Confluent Kafka 4.1x to 5.3x

2020-08-18 Thread Manoj.Agrawal2
You can follow below steps 1. set inter.broker.protocol.version=2.1.x and rolling restart kafka 2. Rolling upgrade the Kafka cluster to 2.5 - 3. rolling upgrade ZK cluster Validate the kafka . 4. set inter.broker.protocol.version= new version and rolling restart the Kafka On 8/18/20, 12:54 P

Steps & best-practices to upgrade Confluent Kafka 4.1x to 5.3x

2020-08-18 Thread Rijo Roy
Hi, I am a newbie in Kafka and would greatly appreciate if someone could help with best-practices and steps to upgrade to v5.3x. Below is my existing set-up: OS version: Ubuntu 16.04.6 LTS ZooKeeper version : 3.4.10 Kafka version : confluent-kafka-2.11 / 1.1.1-cp2 / v4.1.1 We need to upgrade