Recovery skipped after unclean shutdown

2015-09-02 Thread Pradeep Jawahar
One of the brokers in our cluster had an unclean shutdown and after it was restated I found the following logs. $ grep "clean shutdown" /var/groupon/kafka/kafka-broker.log 02/Sep/2015 16:19:23 - warn::[Kafka Server 1], Proceeding to do an unclean shutdown as all the controlled shutdown attempts

Fwd: NotAssignedReplicationException from the ReplicaFetcher threads - version 0.8.1.1

2015-08-05 Thread Pradeep Jawahar
One of the kafka brokers (broker 1) in our kafka cluster went down and we did some reassignments to move partitions off the dead broker. There was some problems in the reassignment and it brought down the broker (Broker 2)to which the older partitions were being assigned to. On restarting the bro

Verify Kafka Broker Readineess

2015-07-10 Thread Pradeep Jawahar
Is there a definitive way to check if a kafka broker is up and ready to accept connections. Can I check some end point etc ? This can also be used when rolling restarts are done. Currently I look at logs or run some smoke tests by publishing/consuming some messages. Just wanted to reach out to the