Failover

2019-01-20 Thread Amin Sadeghi
Hi Please help me for kafka failover https://stackoverflow.com/questions/54274799/kafka-broker-failover-not-worked

Re: Failover

2019-01-20 Thread M. Manna
I’m simply giving my comments but others please correct me if this is not correct. For Scenario 1 - your leader node0 is offline - and your quorum is now not stable. So if a leader goes offline it's not certain who will take over. So that's why 3 is recommended as a minimum, however not the best n

Re: Failover

2019-01-20 Thread Amin Sadeghi
Thanks for answers But if a leader goes offline , when a follower become leader, in other words when a leader of partitions will changed On Sun, Jan 20, 2019 at 3:03 PM M. Manna wrote: > I’m simply giving my comments but others please correct me if this is not > correct. > > For Scenario 1 - you

Re: Failover

2019-01-20 Thread suresh sargar
Zookeeper checks heartbeat of each node.as soon as ZK not able to get heartbeat from leader, re-election happens. Heartbeat check interval is configurable. If u run kafka_topic.sh with describe option u will see newly elected leader and isr will also updated one. On Sun 20 Jan, 2019, 5:53 PM Amin

Re: Failover

2019-01-20 Thread Amin Sadeghi
OK , but after re-election happened , consumers do not consume messages On Sun, Jan 20, 2019 at 4:18 PM suresh sargar wrote: > Zookeeper checks heartbeat of each node.as soon as ZK not able to get > heartbeat from leader, re-election happens. Heartbeat check interval is > configurable. If u run

Re: Failover

2019-01-20 Thread M. Manna
I think you’re slightly confused with what’s going on here. Your quorum is broken- when it becomes 2 nodes, how does it make sense to elect 1 broker and 1 follower ? And why is it that node 1 is the broker, not follower? Your issue is the quorum setup. Your setup can only sustain 1 failure, which

Re: Failover

2019-01-20 Thread M. Manna
Could you show us the output of Kafka-topics.sh describing your desired topic status? On Sun, 20 Jan 2019 at 12:56, M. Manna wrote: > I think you’re slightly confused with what’s going on here. > > Your quorum is broken- when it becomes 2 nodes, how does it make sense to > elect 1 broker and 1

Re: Why do the offsets of the consumer-group (app-id) of my Kafka Streams Application get reset after application restart?

2019-01-20 Thread Matthias J. Sax
Seems this question was cross posted on SO: https://stackoverflow.com/questions/54145281/why-do-the-offsets-of-the-consumer-group-app-id-of-my-kafka-streams-applicatio On 1/14/19 8:49 AM, Jonathan Santilli wrote: > Hello Bill, thanks a lot for the reply, > I will implement your recommendation abo