Re: Kafka Errors and Hung Brokers

2016-12-14 Thread Shailesh Hemdev
ooking at your second point, it seems like > connectivity may be a problem. Where is zookeeper running? do your brokers > have a solid link to that machine? Do you see any zookeeper connection > errors in your broker logs? > > On Tue, Dec 13, 2016 at 6:41 PM, Shailesh Hemdev < >

Kafka Errors and Hung Brokers

2016-12-13 Thread Shailesh Hemdev
why these errors occur 2) Occasionally we will find a Kafka broker that goes down. We have adjusted the Ulimit to increase open files as well as added 6g to the heap. When the broker goes down, the process is itself up but is de registered from Zookeeper Thanks, *Shailesh * -- *Shailesh Hemdev

Kafka Errors and Hung Brokers

2016-12-13 Thread Shailesh Hemdev
We are using a 3 node Kafka cluster and are encountering some weird issues. 1) On Each node, when we tail the server.log file under /var/log/kafka we see continuous errors like these pic-partition. (kafka.server.ReplicaFetcherThread) [2016-12-14 02:39:30,747] ERROR [ReplicaFetcherThread-0-441