Mirror Maker 2 - Issues

2021-03-06 Thread Navneeth Krishnan
Hi All, I'm trying to use mirror maker 2 to replicate data to our new AWS MSK kafka cluster and I have been running into so many issues and I couldn't find proper documentation. Need some help and it's very urgent. Thanks Also I don't see any of my topics created. Note: There are no consumers on

Kafka custom partition - consumers assignor with custom per partition user/custom data

2021-03-06 Thread Mazen Ezzeddine
Hi all, I am implementing a custom consumers to topics/partitions assignor in Kafka. To this end, I am overriding the AbstractPartitionAssignor which in turn implements the ConsumerPartitionAssignor interface. As part of the custom assignor, I want to send a single (float) information about

Re: options for kafka cluster backup?

2021-03-06 Thread Himanshu Shukla
Hi Pushkar, you could also look at the available Kafka-connect plugins. It provides many connectors which could be leveraged to move the data in/out from Kafka. On Sat, Mar 6, 2021 at 10:18 AM Blake Miller wrote: > MirrorMaker is one reasonable way to do this, certainly it can replicate to > an