Hello Experts,
I am trying to replicate data between On Prem Kafka Cluster(Source) and
another Kafka cluster (Target?) set up in a Cloud provider environment.
The On-Prem to cloud is connected via IPSec VPN and Mirror maker tool is
used on 0.10.2.x version.
The consumer configs are as fo
Thanks a lot Stephen..
It worked:)
-Original Message-
From: Stephen Powis [mailto:spo...@salesforce.com]
Sent: Wednesday, March 09, 2016 6:58 PM
To: users@kafka.apache.org
Cc: Kishore N R
Subject: Re: Mirror maker Configs 0.9.0
I've attached my two configs here. Pay close atte
I've attached my two configs here. Pay close attention to the
--num-streams argument to mirror-maker. I have a lot of thru-put on my
topics so I ended up
matching the number of streams = number of partitions for each of my
topics. A stream is essentially just a consumer and producer thread. If
Thanks for the reply..
I will remove the bootstrap.servers property and add zookeeper.connect in
consumer properties and let you know
Also, is there any way we can check how much data the target data center is
lagging behind source DC?
On Wed, Mar 9, 2016 at 3:41 PM, Gerard Klijs
wrote:
>
What do you see in the logs?
It could be it goes wrong because you have the bootstrap.servers property
which is not supported for the old consumer.
On Wed, Mar 9, 2016 at 11:05 AM Gerard Klijs
wrote:
> Don't know the actual question, it matters what you want to do.
> Just watch out trying to cop
Don't know the actual question, it matters what you want to do.
Just watch out trying to copy every topic using a new consumer, cause then
internal topics are copied, leading to errors.
Here is a temple start script we used:
#!/usr/bin/env bash
export KAFKA_JMX_OPTS="-Dcom.sun.management.jmxremote
Hi Experts,
I am trying to replicate data between different data centers using mirror
maker tool.
kafka-run-class.bat kafka.tools.MirrorMaker --consumer.config
consumer.properties --producer.config producer.properties --whitelist *
Can someone provide the sample consumer.properties and producer.
Hi Experts,
I am trying to mirror
--
Regards,
Prabhu.V
