Re: Replication Latencies Mirrormaker 2

2020-10-01 Thread Ananya Sen
I was also facing the same problem. I was using "replication.latency.ms" jmx metric which does not get reset. I started using "replication.latency.avg" which resets when there is no new message to replicate. On Thu, Oct 1, 2020, 7:06 PM Shiva Sagar Reddy Veeram wrote: > I’ve noticed the replica

Re: Mirror Maker 2.0 NOT generating checkpoints for consumers running in assign mode

2020-09-11 Thread Ananya Sen
---> B > > Map newOffsets = > RemoteClusterUtils.translateOffsets(properties, "A", > "TestTopic-123", Duration.ofMillis(5500)); > > > > Properties= Bootstraps properties of cluster B > TestTopic-123= Topic name at cluster A > > Thanks > > > On 9/7/20, 8:43 AM,

Mirror Maker 2.0 NOT generating checkpoints for consumers running in assign mode

2020-09-07 Thread Ananya Sen
Hello All, I was using a mirror maker 2.0. I was testing the consumer checkpointing functionality. I found that the RemoteClusterUtils.translateOffsets do not give checkpoints for the consumer which run in assign mode. I am using mirror maker 2.0 of Kafka Version 2.5.0 and Scala version 2.12 My

Re: Mirror Maker 2.0 Queries

2020-08-20 Thread Ananya Sen
Connector like that, you might consider running MM2's Connectors > manually on a bunch of Connect clusters. This requires more effort to set > up, but enables you to control the configuration of each Connector using > the Connect REST API. > > Ryanne > > On Thu, Aug 20, 2020 at

Re: Mirror Maker 2.0 Queries

2020-08-20 Thread Ananya Sen
tConnector, and 1 for KafkaHeartbeatConnector?* Regards Ananya Sen On Thu, Aug 20, 2020 at 6:39 PM Ryanne Dolan wrote: > Ananya, see responses below. > > > Can this number of workers be configured? > > The number of workers is not exactly configurable, but you can control it

Re: Mirror Maker 2.0 Queries

2020-08-19 Thread Ananya Sen
Any help here would be greatly appreciated. On Sat, Aug 8, 2020, 12:13 PM Ananya Sen wrote: > Thank you Ryanne for the quick response. > I further want to clarify a few points. > > The mirror maker 2.0 is based on the Kafka Connect framework. In Kafka > connect we have multiple w

Re: Mirror Maker 2.0 Queries

2020-08-07 Thread Ananya Sen
up the mirror maker instance so that I can have very little lag? On 2020/07/11 06:37:56, Ananya Sen wrote: > Hi > > I was exploring the Mirror maker 2.0. I read through this > https://cwiki.apache.org/confluence/display/KAFKA/KIP-382%3A+MirrorMaker+2.0 > documentation >

Mirror Maker 2.0 Queries

2020-07-11 Thread Ananya Sen
? Looking forward to your reply. Thanks & Regards Ananya Sen

Kafka Mirror Maker 2.0

2020-07-10 Thread Ananya Sen
I was exploring the Mirror maker 2.0. I read through this https://cwiki.apache.org/confluence/display/KAFKA/KIP-382%3A+MirrorMaker+2.0 documentation and I have a few questions. 1) For running mirror maker as a dedicated mirror maker cluster, the documentation specifies a config file and a st