Re: Get kafka connection status

2015-08-30 Thread Gwen Shapira
Two suggestions: 1. While the consumer is connected, it has one or more threads called "ConsumerFetcherThread---" If you can look at which threads are currently running and check if any called ConsumerFetcherThread-* exist, this is a good indication. The threads are closed when shutdown() is calle

update topic broker list when broker changes

2015-08-30 Thread Emmanuel
Hello, Considering the following setup: 3x zk nodes running 3.5.0-alpha (for the ability to reconfig without shutting down)2x kafka nodes 0.8.2.1 each topic has 10 partitions, replication factor =2 Deploying on GKE, so to automate broker ID definition, I used the IP without the dots as a unique

Get kafka connection status

2015-08-30 Thread yoel g
Hey, I want to create a monitor in my code which sample the Kafka connection and updates a file according to connection status (connected\disconnected). Unfortunately, I couldn't find any field in the "ConsumerConnector" class or any other class which indicates what is the status of the connection.