Re: Unable to start Kafka cluster after crash (0.8.2.2)

2016-02-24 Thread Anthony Sparks
Thank you so much, Alexis -- good to know that those are not actual failures. We were able to get the cluster back up; but with minor data loss. We picked the server with the most up to date offsets of the bunch (it wasn't the most up to date on all topics, but most). We then configured all thre

Re: Unable to start Kafka cluster after crash (0.8.2.2)

2016-02-24 Thread Alexis Midon
regarding the "Allocation Failure" messages, these are not errors, it's the standard behavior of a generational GC. I let you google the details, there are tons of resources. for ex, https://plumbr.eu/blog/garbage-collection/understanding-garbage-collection-logs I believe you should stop the broke

Unable to start Kafka cluster after crash (0.8.2.2)

2016-02-24 Thread Anthony Sparks
Hello, Our Kafka cluster (3 servers, each server has Zookeeper and Kafka installed and running) crashed, and actually out of the 6 processes only one Zookeeper instance remained alive. The logs do not indicate much, the only errors shown were: *2016-02-21T12:21:36.881+: 27445381.013: [GC (Al