I am sorry but could not locate the offset in the request log. I have
turned on the debug for the logs but couldnt . Do you know any pattern
with which i can look in.
Thanks
Arjun Narasimha Kota
On Wednesday 12 February 2014 09:26 PM, Jun Rao wrote:
Interesting. So you have 4 messages in the broker. The checkpointed offset
for the consumer is at the 3rd message. Did you change the default setting
of auto.commit.enable? Also, if you look at the
request log, what's the offset in the fetch request from this consumer?
Thanks,
Jun
On Tue, Feb 11, 2014 at 10:07 PM, Arjun <ar...@socialtwist.com> wrote:
The topic name is correct, the o/p of the ConsumerOffserChecker is
arjunn@arjunn-lt:~/Downloads/Kafka0.8/new/kafka_2.8.0-0.8.0$
bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --group group1
--zkconnect 127.0.0.1:2181,127.0.0.1:2182,127.0.0.1:2183 --topic
taf.referral.emails.service
Group Topic Pid Offset logSize
Lag Owner
group1 taf.referral.emails.service 0 2 4 2
group1_arjunn-lt-1392133080519-e24b249b-0
group1 taf.referral.emails.service 1 2 4 2
group1_arjunn-lt-1392133080519-e24b249b-0
thanks
Arjun Narasimha Kota
On Wednesday 12 February 2014 10:21 AM, Jun Rao wrote:
Could you double check that you used the correct topic name? If so, could
you run ConsumerOffsetChecker as described in
https://cwiki.apache.org/confluence/display/KAFKA/FAQ and see if there is
any lag?
Thanks,
Jun
On Tue, Feb 11, 2014 at 8:45 AM, Arjun Kota <ar...@socialtwist.com>
wrote:
fetch.wait.max.ms=10000
fetch.min.bytes=128
My message size is much more than that.
On Feb 11, 2014 9:21 PM, "Jun Rao" <jun...@gmail.com> wrote:
What's the fetch.wait.max.ms and fetch.min.bytes you used?
Thanks,
Jun
On Tue, Feb 11, 2014 at 12:54 AM, Arjun <ar...@socialtwist.com> wrote:
With the same group id from the console consumer its working fine.
On Tuesday 11 February 2014 01:59 PM, Guozhang Wang wrote:
Arjun,
Are you using the same group name for the console consumer and the
java
consumer?
Guozhang
On Mon, Feb 10, 2014 at 11:38 PM, Arjun <ar...@socialtwist.com>
wrote:
Hi Jun,
No its not that problem. I am not getting what the problem is can you
please help.
thanks
Arjun Narasimha Kota
On Monday 10 February 2014 09:10 PM, Jun Rao wrote:
Does
https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-
Whydoesmyconsumernevergetanydata?
apply?
Thanks,
Jun
On Sun, Feb 9, 2014 at 10:27 PM, Arjun <ar...@socialtwist.com>
wrote:
Hi,
I started using kafka some time back. I was experimenting with 0.8.
My
problem is the kafka is unable to consume the messages. My
configuration
is kafka broker on the local host and zookeeper on the local host.
I
have only one broker and one consumer at present.
What have I done:
1) I used the java examples in the kafka src and pushed
some
600
messages to the broker
2) I used the console consumer to check weather the
messages
are
there in the broker or not. Console consumer printed all 600
messages
3) Now i used the java Consumer code, and tried to get those
messages. This is not printing any messages. It just got stuck
When was it working earlier:
-When i tried with three brokers and three consumers in the
same
machine, with the same configuration it worked fine.
-I changed the properties accordingly when i tried to make
it
work
with one broker and one consumer
What does log say:
- attaching the logs even
If some one points me where I am doing wrong it would be helpful.
Thanks
Arjun Narasimha Kota
