Re: Kafka edge nodes

2016-11-01 Thread Ritesh Tijoriwala
You could have a http front-end to kafka in your primary compute zone and push requests from your edges (http POST) to this frontend which will then use a Kafka producer to publish messages to your central kafka cluster. From: Peter N. Sent: Monday, October 31,

No replicafetcher threads on one broker

2016-10-31 Thread Ritesh Tijoriwala
Hi, One of my broker logs don't show any replica fetcher thread instances. I took a thread dump and no threads found by name "ReplicaFetcherThread*". I do see these threads on other broker instances. This broker is also not part of ISR. Any ideas on what could be wrong? Thanks, Ritesh

monitor replica lag

2016-10-30 Thread Ritesh Tijoriwala
Hi All, We are using kafka 0.8.1.1 and one of our brokers got kicked out of the ISR list after a restart. The restart was to increase the number of replica fetcher threads from 1 to 4. Now, it fails to get back in the ISR list even after waiting for 1 day. We had it restart few times but no luc