Re: MirrorMaker and identical replicas

2016-06-01 Thread Gerard Klijs
No you can't because: - because of producer failures some messages may be duplicated. - your not sure the cluster your copying from hasn't some already removed data. We try to solve the same problem, and are probably going to solve it by copying the timestamps with the mirror maker, and on the swi

MirrorMaker and identical replicas

2016-06-01 Thread Dave Cahill
Hi, I've read up a little on MirrorMaker (e.g. the wiki [1] and KIP-3 [2]), but haven't yet found a definitive answer to the following question. Let's assume I am producing a certain topic to a Kafka cluster in datacenter A. I set up MirrorMaker in datacenter B and C to mirror the topic from dat