Re: MirrorMaker - Topics Identification and Replication

2017-01-05 Thread Ewen Cheslack-Postava
That all sounds right! Usually the delay for picking up the metadata update and starting to replicate the topic won't be an issue since it's a one-time issue (around topic creation) and the time window is pretty small for that. In steady state, none of the mentioned delays would apply. -Ewen On

Re: MirrorMaker - Topics Identification and Replication

2017-01-05 Thread Greenhorn Techie
Thanks Ewen for your response. Just to summarise, here is my understanding. Apologies if something is mis-understood. I am new to Kafka and hence still short in knowledge. - MirrorMarker process automatically picks-up new topics added on the source cluster and hence no restart of the proce

Re: MirrorMaker - Topics Identification and Replication

2017-01-03 Thread Ewen Cheslack-Postava
Yes, the consumer will pick up the new topics when it refreshes metadata (defaults to every 5 min) and start subscribing to the new topics. -Ewen On Tue, Jan 3, 2017 at 3:07 PM, Greenhorn Techie wrote: > Hi, > > I am new to Kafka and as well as MirrorMaker. So wondering whether MM would > pick-

MirrorMaker - Topics Identification and Replication

2017-01-03 Thread Greenhorn Techie
Hi, I am new to Kafka and as well as MirrorMaker. So wondering whether MM would pick-up new topics that are created on the source cluster automatically, provided topic matches the while list pattern? For example, if I start MM as below, would it replicate any new topics that are created after the