If you want to monitor offset (ZK or Kafka based), try with QuantFind's Kafka Offset Monitor. If you use Docker, it's easy as:
docker run -p 8080:8080 -e ZK=zk_hostname:2181 jpodeszwik/kafka-offset-monitor and then opening browser to dockerhost:8080. If not in the Docker mood, use instructions here: https://github.com/quantifind/KafkaOffsetMonitor Marko Bonaći Monitoring | Alerting | Anomaly Detection | Centralized Log Management Solr & Elasticsearch Support Sematext <http://sematext.com/> | Contact <http://sematext.com/about/contact.html> On Wed, Dec 30, 2015 at 12:54 PM, Han JU <ju.han.fe...@gmail.com> wrote: > Thanks guys. The `seek` seems a solution. But it's more cumbersome than in > 0.8 because I have to plug in some extra code in my consumer abstractions > rather than simply deleting a zk node. > And one more question: where does kafka 0.9 stores the consumer-group > information? In fact I also tried to delete the consumer group but the > `AdminUtils.deleteConsumerGroupInZK` does not seem to work in 0.9. And also > `bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --zookeeper > localhost:2181 --group group-name` seems broken. > > Thanks! > > 2015-12-29 16:46 GMT+01:00 Marko Bonaći <marko.bon...@sematext.com>: > > > I was refering to Dana Powers's answer in the link I posted (to use a > > client API). You can find an example here: > > > > > http://kafka.apache.org/090/javadoc/org/apache/kafka/clients/consumer/KafkaConsumer.html > > > > Marko Bonaći > > Monitoring | Alerting | Anomaly Detection | Centralized Log Management > > Solr & Elasticsearch Support > > Sematext <http://sematext.com/> | Contact > > <http://sematext.com/about/contact.html> > > > > On Tue, Dec 29, 2015 at 4:41 PM, Stevo Slavić <ssla...@gmail.com> wrote: > > > > > Then I guess @Before test, explicitly commit offset of 0. > > > > > > There doesn't seem to be a tool for committing offset, only for > > > checking/fetching current offset (see > > > http://kafka.apache.org/documentation.html#operations ) > > > > > > On Tue, Dec 29, 2015 at 4:35 PM, Han JU <ju.han.fe...@gmail.com> > wrote: > > > > > > > Hi Stevo, > > > > > > > > But by deleting and recreating the topic, do I remove also the > messages > > > > ingested? > > > > My use case is that I ingest prepared messages once and run consumer > > > tests > > > > multiple times, between each test run I reset the consumer group's > > offset > > > > so that each run starts from the beginning and consumers all the > > > messages. > > > > > > > > 2015-12-29 16:19 GMT+01:00 Stevo Slavić <ssla...@gmail.com>: > > > > > > > > > Have you considered deleting and recreating topic used in test? > > > > > Once topic is clean, read/poll once - any committed offset should > be > > > > > outside of the range, and consumer should reset offset. > > > > > > > > > > On Tue, Dec 29, 2015 at 4:11 PM, Han JU <ju.han.fe...@gmail.com> > > > wrote: > > > > > > > > > > > Hello, > > > > > > > > > > > > For local test purpose I need to frequently reset offset for a > > > consumer > > > > > > group. In 0.8 I just delete the consumer group's zk node under > > > > > > `/consumers`. But with the redesign of the 0.9, how could I > achieve > > > the > > > > > > same thing? > > > > > > > > > > > > Thanks! > > > > > > > > > > > > -- > > > > > > *JU Han* > > > > > > > > > > > > Software Engineer @ Teads.tv > > > > > > > > > > > > +33 0619608888 > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > *JU Han* > > > > > > > > Software Engineer @ Teads.tv > > > > > > > > +33 0619608888 > > > > > > > > > > > > > -- > *JU Han* > > Software Engineer @ Teads.tv > > +33 0619608888 >
