Steps & best-practices to upgrade Confluent Kafka 4.1x to 5.3x

2020-08-18 Thread Rijo Roy
our OS version to Ubuntu 18.04 LTS whose minimum requirement is to upgrade Kafka to v5.3x. Could someone please help me with the best-practices & steps for the upgrade.. Please let me know if you need any more information so that you could help me. Appreciate your help! Thanks & Regar

Re: Steps & best-practices to upgrade Confluent Kafka 4.1x to 5.3x

2020-08-19 Thread Rijo Roy
grade.. Thanks & Regards, Rijo Roy On 2020/08/18 20:45:42, wrote: > You can follow below steps > > 1. set inter.broker.protocol.version=2.1.x and rolling restart kafka > 2. Rolling upgrade the Kafka cluster to 2.5 - > 3. rolling upgrade ZK cluster > Valid

Re: Steps & best-practices to upgrade Confluent Kafka 4.1x to 5.3x

2020-08-19 Thread Rijo Roy
Thanks Manoj! Yeah, the plan is to start with non-prod and validate first before going to prod. Thanks & Regards, Rijo Roy On 2020/08/19 17:33:53, wrote: > I advise to do it non-prod for validation . > You can backup data log folder if you want but I have'nt see any issue . b

Re: Steps & best-practices to upgrade Confluent Kafka 4.1x to 5.3x

2020-08-19 Thread Rijo Roy
Sure Manoj! Really appreciate your quick response.. On 2020/08/19 17:40:54, wrote: > Great . > Share your finding to this group once you done upgrade Confluent Kafka 4.1x > to 5.3x successfully . > > I see many people having same question here . > > On 8/19/20

Re: Steps & best-practices to upgrade Confluent Kafka 4.1x to 5.3x

2020-09-01 Thread Rijo Roy
there are no files in /var/log/kafka but in the updated ZK follower node which is failing to start has files written to /var/log/kafka Please help.. Thanks, Rijo Roy On 2020/08/19 17:52:34, Rijo Roy wrote: > Sure Manoj! > > Really appreciate your quick response.. > >

Re: UPGRADING ZOOKEEPER FROM 3.4.13 TO 3.5.7

2020-09-02 Thread Rijo Roy
will sync create the version_2 folder into its data directory. Regards,Rijo Roy Sent from Yahoo Mail on Android On Thu, 3 Sep 2020 at 2:57 am, manoj.agraw...@cognizant.com wrote: HI ALL , I’m planning to upgrade the Kafka 2.2.1 to kafka 2.5.0 , I m getting below error while upgrading

Help needed to migrate from one infra to another without downtime

2021-10-20 Thread Rijo Roy
Hi,  Hope you are safe and well! Let me give a brief about my environment: OS: Ubuntu 18.04 Kafka Version: Confluent Kafka v5.5.1 ZooKeeper Version : 3.5.8 No.of Kafka Brokers: 3 No. of Zookeeper nodes: 3 I am working on a project where we are aiming to move out from our existing infrastructur

Re: Help needed to migrate from one infra to another without downtime

2021-10-25 Thread Rijo Roy
uggest > checking this matter, 3 , 5 , 7 etc... > > בתאריך יום ד׳, 20 באוק׳ 2021, 22:00, מאת Rijo Roy > ‏: > > > Hi, > > > > Hope you are safe and well! > > > > Let me give a brief about my environment: > > > > OS: Ubuntu 18.04 > > Kafka Ve

MirrorMaker2 fails to replicate - please urgent help needed

2021-10-25 Thread Rijo Roy
Hi, I was very much relieved to see MirrorMaker2 working in my sandbox for a major project where we are migrating out of cluster A to cluster B for a better hardware. To my surprise, it fails to migrate any user topics when I used it in one of our real pre-prod environments where we have real t

Re: MirrorMaker2 fails to replicate - please urgent help needed

2021-10-25 Thread Rijo Roy
. Ryanne On Mon, Oct 25, 2021, 2:42 PM Rijo Roy wrote: > Hi, > > I was very much relieved to see MirrorMaker2 working in my sandbox for a > major project where we are migrating out of cluster A to cluster B for a > better hardware. To my surprise, it fails to migrate any user

Re: MirrorMaker2 fails to replicate - please urgent help needed

2021-10-26 Thread Rijo Roy
like mm can reach the bootstrap servers, but then these brokers are providing the wrong listeners (in metadata responses). This would explain why mm can create topics but not replicate. Ryanne On Mon, Oct 25, 2021, 3:38 PM Rijo Roy wrote: >  Hi Ryanne, > > Thanks for responding! >

Re: MirrorMaker2 fails to replicate - please urgent help needed

2021-12-02 Thread Rijo Roy
October, 2021, 09:39:54 pm IST, Rijo Roy wrote: Thanks again Ryanne. Even though telnet worked, I ran a AWS Reachability analyser check between A and B and looks like I have few network issues to resolve as they cannot talk to each other which could be the cause of mm2 not replicating data

Mirrormaker2 fails to replicate a big topic from source to target

2021-12-02 Thread Rijo Roy
eplicationPolicy groups = .* tasks.max=100 emit.checkpoints.interval.seconds = 10 security.protocol=SASL_PLAINTEXT sasl.mechanism=PLAIN sasl.jaas.config=org.apache.kafka.common.security.plain.PlainLoginModule required \   username="CONFIDENTIAL" \   password="vvv"; Thanks & Regards, Rijo Roy

Re: Mirrormaker2 fails to replicate a big topic from source to target

2021-12-03 Thread Rijo Roy
increased to 167GB and now constantly reducing in every minute (size as of now is 39GB). I am stuck in moving ahead with the same and would really appreciate your help on the same. Thanks, Rijo Roy On Thursday, 2 December, 2021, 11:20:29 pm IST, Rijo Roy wrote: Hi,  Hope you all are

Re: Mirrormaker2 fails to replicate a big topic from source to target

2021-12-03 Thread Rijo Roy
properties and mm2.properties  max.request.size=3950161 max.message.bytes=3950161 message.max.bytes=3950161 but no luck! Could someone please help on the issue as it looks to be a bug again with mm2 -  https://issues.apache.org/jira/browse/KAFKA-6177  Thanks & Regards, Rijo Roy On Frid