Hi,

I'd like to throttle the mirroring process when I start Mirror Maker 2 at
the first time, so it starts to pull all the messages that exists on the
source cluster. I'd like to do this only to avoid putting too much traffic
on the source cluster that may slow down existing production client on it.

I tried several quota setups on both the source and destination clusters,
both none of them worked.
- it either did not have any affect
- or slowed down the mirroring but also cause issues like
ERROR WorkerSourceTask{id=MirrorHeartbeatConnector-0} Failed to flush,
timed out while waiting for producer to flush outstanding 115 messages

Is there a good practice on how to initialize/bootstrap a MirrorMaker
cluster on an existing Kafka cluster?

Cheers,
Peter

Reply via email to