Hi,
very likely due to timing. What problem is it causing you exactly that
you want to work around?
These differences shouldn't concern you to much I guess.
We use the tool across continents and don't worry about it to much.
Offset Commit interval makes everything blury anyways. If you can
specify your pain more precisely maybe we can work around it.
Best Jan
On 10.07.2017 10:31, Dmitriy Vsekhvalnov wrote:
Guys, let me up this one again. Still looking for comments about
kafka-consumer-groups.sh
tool.
Thank you.
On Fri, Jul 7, 2017 at 3:14 PM, Dmitriy Vsekhvalnov <dvsekhval...@gmail.com>
wrote:
I've tried 3 brokers on command line, like that:
/usr/local/kafka/bin/kafka-consumer-groups.sh --bootstrap-server
broker:9092,broker_2:9092,broker_3:9092 --new-consumer --group
logging-svc --describe
it doesn't make any difference, still x10 times difference in figures when
running on broker host vs. remote
Here is snippet from console output (are you looking something specific in
it? it looks normal a far as i can say):
TOPIC PARTITION CURRENT-OFFSET LOG-END-OFFSET LAG
CONSUMER-ID
test.topic 54 4304 4309 35
consumer-26-21f5050c-a43c-4254-bfcf-42e17dbdb651
test.topic 40 4426 4436 10
consumer-21-24f3ebca-004f-4aac-a348-638c9c6a02f0
test.topic 59 4414 4420 63
consumer-27-ed34f1b3-1be9-422b-bb07-e3c9913195c7
test.topic 42 4389 4403 76
consumer-22-75c2fc0a-5d5c-472d-b27e-e873030f82b6
test.topic 27 4416 4422 24
consumer-18-3be20568-8dd3-4679-a008-0ca64d31083c
On Fri, Jul 7, 2017 at 2:52 PM, M. Manna <manme...@gmail.com> wrote:
kafka-consumer-groups.sh --bootstrap-server broker:9092 --new-consumer
--group service-group --describe
how many brokers do you have in the cluster? if you have more than one,
list them all using a comma csv with --bootstrap-server.
Also, could you paste some results from the console printout?
On 7 July 2017 at 12:47, Dmitriy Vsekhvalnov <dvsekhval...@gmail.com>
wrote:
Hi all,
question about lag checking. We've tried to periodically sample consumer
lag with:
kafka-consumer-groups.sh --bootstrap-server broker:9092 --new-consumer
--group service-group --describe
it's all fine, but depending on host we run it from it gives different
results.
E.g:
- when running from one of the broker hosts itself we getting close
to 0
figures.
- when running from remote host, we getting 30-60 in average (i
suspect
there are multiple remote calls to broker involved, so difference due to
timing).
My question is what is correct way to use it? From broker host itself?
