Thanks Waleed, I did read those guides and basically it was the reason I've asked how Kafka is supposed to be managed.
I believe managing small-ish cluster with 3-5, maybe dozen nodes is doable with scripts. But what happens on the scale betoubd that? -- Roman On Fri, May 26, 2017 at 4:19 PM Waleed Fateem <waleed.fat...@gmail.com> wrote: > Hi Roman, > > I have not heard of an automated way to do this. You have to manually > reassign partitions from the Kafka broker you're planning on removing from > the cluster. Have a look at the section "decommissioning brokers" in the > documentation: > https://kafka.apache.org/documentation/#basic_ops_decommissioning_brokers > > On Fri, May 26, 2017 at 2:15 PM, Roman Naumenko <ro...@sproutling.com> > wrote: > > > Hi, > > > > We’re running Kafka in AWS with replication factor 2. There is a > > requirement to rotate servers periodically (or add new ones). > > Is there a way to make Kafka remove “failed” instances from cluster, > > rebalance automatically whatever it needs to rebalance and continue to > work > > as usual? > > > > I’ve looked up few guides and it seems like there are tons of manual > steps > > required to make it work. > > > > —R >
