MirrorMaker 2.0 - Translating offsets for remote topics and consumer groups

2020-08-18 Thread Josh C
Hi there, I'm currently exploring MM2 and having some trouble with the RemoteClusterUtils.translateOffsets() method. I have been successful in migrating a consumer group from the source cluster to the target cluster, but was wondering how I could migrate this consumer group back to the original so

Re: Steps & best-practices to upgrade Confluent Kafka 4.1x to 5.3x

2020-08-18 Thread Manoj.Agrawal2
You can follow below steps 1. set inter.broker.protocol.version=2.1.x and rolling restart kafka 2. Rolling upgrade the Kafka cluster to 2.5 - 3. rolling upgrade ZK cluster Validate the kafka . 4. set inter.broker.protocol.version= new version and rolling restart the Kafka On 8/18/20, 12:54 P

Re: [VOTE] KIP-657: Add Customized Kafka Streams Logo

2020-08-18 Thread Matthias J. Sax
Adding the user mailing list -- I think we should accepts votes on both lists for this special case, as it's not a technical decision. @Boyang: as mentioned by Bruno, can we maybe add black/white options for both proposals, too? I also agree that Design B is not ideal with regard to the Kafka log

Steps & best-practices to upgrade Confluent Kafka 4.1x to 5.3x

2020-08-18 Thread Rijo Roy
Hi, I am a newbie in Kafka and would greatly appreciate if someone could help with best-practices and steps to upgrade to v5.3x. Below is my existing set-up: OS version: Ubuntu 16.04.6 LTS ZooKeeper version : 3.4.10 Kafka version : confluent-kafka-2.11 / 1.1.1-cp2 / v4.1.1 We need to upgrade

CPU usage spikes and replication failure

2020-08-18 Thread Toby Bristow
Hi, Running Kafka 2.5.0_2.12. We run 3 identically configured kafka clusters (one in each region) and on one of them we've recently started having regular issues with spikes in CPU utilization lasting a few hours. In some cases we see large numbers of what look like replication failures, with the