Re: Prevent broker from leading topic partitions

2016-08-22 Thread Alexey Ozeritsky
Hi 22.08.2016, 19:16, "Tom Crayford" : > Hi, > > I don't think I understand *why* you need this. Kafka is by default a > distributed HA system that balances data and leadership over nodes. Why do > you need to change this? In fact, kafka does not balance anything. It uses static partition distrib

Re: Prevent broker from leading topic partitions

2016-08-22 Thread Tom Crayford
Hi, I don't think I understand *why* you need this. Kafka is by default a distributed HA system that balances data and leadership over nodes. Why do you need to change this? You could accomplish something like this with mirror maker, that may make more sense. Thanks Tom Crayford Heroku Kafka

Prevent broker from leading topic partitions

2016-08-22 Thread Jason Aliyetti
I have a use case that requires a 2 node deployment with a Kafka-backed service with the following constraints: - All data must be persisted to node 1. If node 1 fails (regardless of the status of node 2), then the system must stop. - If node 2 is up, then it must stay in synch with node 1. - If