Re: Number of Consumers Connected

You can specify the consumer configs in the config file pointed by "--consumer.config Consumer config properties file.", for example: auto.commit.enable=true auto.commit.interval.ms=1000 Guozhang On Tue, Feb 3, 2015 at 4:54 PM, Sa Li wrote: > Hi, Guozhang > > Thank you very much for t

Re: Number of Consumers Connected

Hi, Guozhang Thank you very much for the reply, as you mentioned, I download the latest version https://www.apache.org/dyn/closer.cgi?path=/kafka/0.8.2-beta/kafka-0.8.2-beta-src.tgz Untar this build and here is what I see root@DO-mq-dev:/home/stuser/kafka-0.8.2-beta-src/bin# kafka-console-consu

Re: Number of Consumers Connected

Hello Sa, Could you try the latest 0.8.2 release, whose console consumer tool has been polished a bit with clearer properties? Guozhang On Tue, Feb 3, 2015 at 10:32 AM, Sa Li wrote: > GuoZhang > > Sorry for leaving this topic for a while, I am still not clear how to > commit the offset to zk

Re: Number of Consumers Connected

GuoZhang Sorry for leaving this topic for a while, I am still not clear how to commit the offset to zk from commandline, I tried this bin/kafka-console-consumer.sh --zookeeper 10.100.71.33:2181 --topic pipe-test-2 --from-beginning --property pipe It seems generate a console-consumer-001 in zK, b

Re: Number of Consumers Connected

It seems not the latest version of Kafka, which version are you using? On Tue, Jan 20, 2015 at 9:46 AM, Sa Li wrote: > Guozhang > > Thank you very much for reply, here I print out the > kafka-console-consumer.sh help, > > root@voluminous-mass:/srv/kafka# bin/kafka-console-consumer.sh > Missing r

Re: Number of Consumers Connected

Guozhang Thank you very much for reply, here I print out the kafka-console-consumer.sh help, root@voluminous-mass:/srv/kafka# bin/kafka-console-consumer.sh Missing required argument "[zookeeper]" Option Description -- -

Re: Number of Consumers Connected

There is a property config you can set via bin/kafka-console-consumer.sh to commit offsets to ZK, you can use bin/kafka-console-consumer.sh --help to list all the properties. Guozhang On Mon, Jan 19, 2015 at 5:15 PM, Sa Li wrote: > Guozhang, > > Currently we are in the stage to testing producer

Re: Number of Consumers Connected

Guozhang, Currently we are in the stage to testing producer, our C# producer sending data to brokers, and use bin/kafka-run-class.sh org.apache.kafka.clients.tools.ProducerPerformance command to produce the messages. We don't have a coded consumer to commit offset, we use bin/kafka-console-consum

Re: Number of Consumers Connected

Sa, Did your consumer ever commit offsets to Kafka? If not then no corresponding ZK path will be created. Guozhang On Mon, Jan 19, 2015 at 3:58 PM, Sa Li wrote: > Hi, > > I use such tool > > Consumer Offset Checker > > Displays the: Consumer Group, Topic, Partitions, Offset, logSize, Lag, > O

Re: Number of Consumers Connected

Hi, I use such tool Consumer Offset Checker Displays the: Consumer Group, Topic, Partitions, Offset, logSize, Lag, Owner for the specified set of Topics and Consumer Group bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker To be able to know the consumer group, in zkCli.sh [zk: localhos

Re: Number of Consumers Connected

got it ... thanks a lot. Regards, Nitin Kumar Sharma. On Mon, Dec 15, 2014 at 9:26 PM, Gwen Shapira wrote: > > Hi Nitin, > > Go to where you installed zookeeper and run: > > bin/zkCli.sh -server 127.0.0.1:2181 > > On Mon, Dec 15, 2014 at 6:09 PM, nitin sharma > wrote: > > Thanks Neha and Gwen

Re: Number of Consumers Connected

Hi Nitin, Go to where you installed zookeeper and run: bin/zkCli.sh -server 127.0.0.1:2181 On Mon, Dec 15, 2014 at 6:09 PM, nitin sharma wrote: > Thanks Neha and Gwen for your responses.. > > @Gwen -- Kindly explain how to perform the steps you have mentioned. how > should i connect to a zookee

Re: Number of Consumers Connected

Thanks Neha and Gwen for your responses.. @Gwen -- Kindly explain how to perform the steps you have mentioned. how should i connect to a zookeeper..? Regards, Nitin Kumar Sharma. On Mon, Dec 15, 2014 at 6:36 PM, Neha Narkhede wrote: > > In addition to Gwen's suggestion, we actually don't have

Re: Number of Consumers Connected

In addition to Gwen's suggestion, we actually don't have jmx metrics that give you a list of actively consuming processes. On Mon, Dec 15, 2014 at 12:59 PM, Gwen Shapira wrote: > > Currently you can find the number of consumer groups through ZooKeeper: > > connect to ZK and run > ls /consumers >

Re: Number of Consumers Connected

Currently you can find the number of consumer groups through ZooKeeper: connect to ZK and run ls /consumers and count the number of results On Mon, Dec 15, 2014 at 11:34 AM, nitin sharma wrote: > Hi Team, > > Is it possible to know how many Consumer Group connected to kafka broker Ids > and as

Number of Consumers Connected

Hi Team, Is it possible to know how many Consumer Group connected to kafka broker Ids and as well as how many Instances within a Group are fetching messages from Kafka Brokers Regards, Nitin Kumar Sharma.