Re: Using Kafka Metrics

2013-09-18 Thread Neha Narkhede
Each broker will only report metrics for the partitions that exist on that broker. In order to get a global view of metrics, you will need to collect metrics from all brokers. Thanks, Neha On Wed, Sep 18, 2013 at 3:07 PM, Vimpy Batra wrote: > In case there are multiple brokers, is there an ove

Re: Using Kafka Metrics

2013-09-18 Thread Vimpy Batra
In case there are multiple brokers, is there an overlap in the metric values they report? Let's say a topic is partitioned onto multiple broker nodes and we want topic level metrics. Will all the brokers be reporting the same value? Should we tap into one broker to get all the metrics or do we n

Re: Using Kafka Metrics

2013-09-18 Thread Neha Narkhede
If you start a Kafka broker, it should start reporting metrics automatically. But I'm not sure if I understood your question completely. Can you elaborate on what problem you saw with metrics collection? Thanks, Neha On Wed, Sep 18, 2013 at 2:20 PM, Vimpy Batra wrote: > Hi, > > I am using Kafk

Re: problem to start a kafka broker from java unit tests

2013-09-18 Thread Neha Narkhede
I tried your test on 0.8 HEAD and it succeeded. Here is the log4j output from the test run - http://pastebin.com/sP98SJuu Could you try running your test again on 0.8 HEAD ? Thanks, Neha On Tue, Sep 17, 2013 at 11:46 AM, Wu, Jiang2 wrote: > Hi, > > I have some problem to start a local broker

Re: Leader doesn't get assigned for new topics

2013-09-18 Thread Neha Narkhede
When new topics are created, it takes some time for the controller to communicate the partition assignment for the new topic to all brokers. Until that happens, attempts to send/receive data to the brokers fails with the following kind of error - [2013-09-17 19:21:36,531] WARN [KafkaApi-2] Produce

Using Kafka Metrics

2013-09-18 Thread Vimpy Batra
Hi, I am using Kafka-0.8 and have a module to write metrics to Graphite. I have a multi node cluster and was wondering if I need to enable metrics reporting on all of them. Any advice will be helpful. Thanks,

Re: Leader doesn't get assigned for new topics

2013-09-18 Thread Rajasekar Elango
>From the output of StateChangeLogMerger tool, I see only this error repeated; [2013-09-18 14:16:48,358] ERROR [KafkaApi-1] Error while fetching metadata for partition [FunnelProto,0] (kafka.server.KafkaApis) On the state-change.log itself, I see this error: [2013-09-18 14:22:48,954] ERROR Condi