Hello,

I have a next use case:
I need to mirror some partitions in some topics at some cluster to totally
different cluster into some topic into some partition. Is it possible to
organize with MirrorMaker tool or any other tools?

Here is an example:
I have 3 data centers: DC1, DC2, DC3
Each data center has a local Kafka cluster.
Each cluster has a topic: "TestTopic".
Each topic has 3 partitions: 1, 2, 3

Now I need to consume all messages from DC1 "TestTopic" partition 3 and DC2
"TestTopic" partition 3 and publish all messages into DC3 "TestTopic"
partition 3.
Also, it would be great if the messages could be deleted from DC1 and DC2
after messages are published into DC3.

partition 1 and partition 2 have to be mirrored with the same logic. I.e.
DC2 "TestTopic" partition 1 and DC3 "TestTopic" partition 1 have to be
copied into DC1 "TestTopic" partition 1.

Is it possible to organize such a mirror logic?

Best regards,
Alexandr

Reply via email to