The request log is in trace. Take a look at the log4j property file in config/.
Thanks, Jun On Wed, Feb 12, 2014 at 9:45 PM, Arjun <ar...@socialtwist.com> wrote: > I am sorry but could not locate the offset in the request log. I have > turned on the debug for the logs but couldnt . Do you know any pattern with > which i can look in. > > Thanks > Arjun Narasimha Kota > > > On Wednesday 12 February 2014 09:26 PM, Jun Rao wrote: > >> Interesting. So you have 4 messages in the broker. The checkpointed offset >> for the consumer is at the 3rd message. Did you change the default setting >> of auto.commit.enable? Also, if you look at the >> request log, what's the offset in the fetch request from this consumer? >> Thanks, >> Jun >> >> >> On Tue, Feb 11, 2014 at 10:07 PM, Arjun <ar...@socialtwist.com> wrote: >> >> The topic name is correct, the o/p of the ConsumerOffserChecker is >>> >>> arjunn@arjunn-lt:~/Downloads/Kafka0.8/new/kafka_2.8.0-0.8.0$ >>> bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --group group1 >>> --zkconnect 127.0.0.1:2181,127.0.0.1:2182,127.0.0.1:2183 --topic >>> taf.referral.emails.service >>> Group Topic Pid Offset logSize >>> Lag Owner >>> group1 taf.referral.emails.service 0 2 4 2 >>> group1_arjunn-lt-1392133080519-e24b249b-0 >>> group1 taf.referral.emails.service 1 2 4 2 >>> group1_arjunn-lt-1392133080519-e24b249b-0 >>> >>> thanks >>> Arjun Narasimha Kota >>> >>> >>> >>> >>> On Wednesday 12 February 2014 10:21 AM, Jun Rao wrote: >>> >>> Could you double check that you used the correct topic name? If so, >>>> could >>>> you run ConsumerOffsetChecker as described in >>>> https://cwiki.apache.org/confluence/display/KAFKA/FAQ and see if there >>>> is >>>> any lag? >>>> >>>> Thanks, >>>> >>>> Jun >>>> >>>> >>>> On Tue, Feb 11, 2014 at 8:45 AM, Arjun Kota <ar...@socialtwist.com> >>>> wrote: >>>> >>>> fetch.wait.max.ms=10000 >>>> >>>>> fetch.min.bytes=128 >>>>> >>>>> My message size is much more than that. >>>>> On Feb 11, 2014 9:21 PM, "Jun Rao" <jun...@gmail.com> wrote: >>>>> >>>>> What's the fetch.wait.max.ms and fetch.min.bytes you used? >>>>> >>>>>> Thanks, >>>>>> >>>>>> Jun >>>>>> >>>>>> >>>>>> On Tue, Feb 11, 2014 at 12:54 AM, Arjun <ar...@socialtwist.com> >>>>>> wrote: >>>>>> >>>>>> With the same group id from the console consumer its working fine. >>>>>> >>>>>>> >>>>>>> On Tuesday 11 February 2014 01:59 PM, Guozhang Wang wrote: >>>>>>> >>>>>>> Arjun, >>>>>>> >>>>>>>> Are you using the same group name for the console consumer and the >>>>>>>> >>>>>>>> java >>>>>>> >>>>>> consumer? >>>>>> >>>>>>> Guozhang >>>>>>>> >>>>>>>> >>>>>>>> On Mon, Feb 10, 2014 at 11:38 PM, Arjun <ar...@socialtwist.com> >>>>>>>> >>>>>>>> wrote: >>>>>>> >>>>>> Hi Jun, >>>>>> >>>>>>> No its not that problem. I am not getting what the problem is can you >>>>>>>>> please help. >>>>>>>>> >>>>>>>>> thanks >>>>>>>>> Arjun Narasimha Kota >>>>>>>>> >>>>>>>>> >>>>>>>>> On Monday 10 February 2014 09:10 PM, Jun Rao wrote: >>>>>>>>> >>>>>>>>> Does >>>>>>>>> >>>>>>>>> https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ- >>>>>>>>>> Whydoesmyconsumernevergetanydata? >>>>>>>>>> apply? >>>>>>>>>> >>>>>>>>>> Thanks, >>>>>>>>>> >>>>>>>>>> Jun >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Sun, Feb 9, 2014 at 10:27 PM, Arjun <ar...@socialtwist.com> >>>>>>>>>> >>>>>>>>>> wrote: >>>>>>>>> >>>>>>>> Hi, >>>>>> >>>>>>> I started using kafka some time back. I was experimenting with 0.8. >>>>>>>>>> My >>>>>>>>>> >>>>>>>>> problem is the kafka is unable to consume the messages. My >>>>>>> >>>>>>>> configuration >>>>>>>>>>> is kafka broker on the local host and zookeeper on the local >>>>>>>>>>> host. >>>>>>>>>>> >>>>>>>>>>> I >>>>>>>>>> >>>>>>>>> have only one broker and one consumer at present. >>>>>> >>>>>>> What have I done: >>>>>>>>>>> 1) I used the java examples in the kafka src and pushed >>>>>>>>>>> some >>>>>>>>>>> >>>>>>>>>>> 600 >>>>>>>>>> >>>>>>>>> messages to the broker >>>>>>> >>>>>>>> 2) I used the console consumer to check weather the >>>>>>>>>>> messages >>>>>>>>>>> >>>>>>>>>>> are >>>>>>>>>> >>>>>>>>> there in the broker or not. Console consumer printed all 600 >>>>>>> >>>>>>>> messages >>>>>>>>>> >>>>>>>>> 3) Now i used the java Consumer code, and tried to get >>>>>> those >>>>>> >>>>>>> messages. This is not printing any messages. It just got stuck >>>>>>>>>>> >>>>>>>>>>> When was it working earlier: >>>>>>>>>>> -When i tried with three brokers and three consumers in >>>>>>>>>>> the >>>>>>>>>>> >>>>>>>>>>> same >>>>>>>>>> >>>>>>>>> machine, with the same configuration it worked fine. >>>>>>> >>>>>>>> -I changed the properties accordingly when i tried to make >>>>>>>>>>> >>>>>>>>>>> it >>>>>>>>>> >>>>>>>>> work >>>>>> >>>>>>> with one broker and one consumer >>>>>>>>>>> >>>>>>>>>>> What does log say: >>>>>>>>>>> - attaching the logs even >>>>>>>>>>> >>>>>>>>>>> If some one points me where I am doing wrong it would be helpful. >>>>>>>>>>> >>>>>>>>>>> Thanks >>>>>>>>>>> Arjun Narasimha Kota >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >
