Re: Mirror maker higher offset in the mirror.

2016-07-25 Thread Gerard Klijs
Things like consumer rebalances on the cluster you copy from, and brokers going down on the cluster your writing down can cause duplications. The default settings are set to prevent data loss, making data duplication more likely to happen in case of error. You could possibly make a simple consumer

Mirror maker higher offset in the mirror.

2016-07-24 Thread Sathyakumar Seshachalam
Am trying to mirror from a production Kafka cluster to a DR cluster. However the offsets between topics (retrieved with GetOffsetShell ) on these two clusters do not always match. While a lesser offset is t