I don't see the log in your email. Perhaps you can send out a link to things like pastebin?
Thanks, Jun On Thu, Feb 13, 2014 at 8:06 AM, Arjun Kota <ar...@socialtwist.com> wrote: > Yes i have made it to trace as it will help me debug the things. > Have u found any issue in the it. > On Feb 13, 2014 9:12 PM, "Jun Rao" <jun...@gmail.com> wrote: > > > The request log is in trace. Take a look at the log4j property file in > > config/. > > > > Thanks, > > > > Jun > > > > > > On Wed, Feb 12, 2014 at 9:45 PM, Arjun <ar...@socialtwist.com> wrote: > > > > > I am sorry but could not locate the offset in the request log. I have > > > turned on the debug for the logs but couldnt . Do you know any pattern > > with > > > which i can look in. > > > > > > Thanks > > > Arjun Narasimha Kota > > > > > > > > > On Wednesday 12 February 2014 09:26 PM, Jun Rao wrote: > > > > > >> Interesting. So you have 4 messages in the broker. The checkpointed > > offset > > >> for the consumer is at the 3rd message. Did you change the default > > setting > > >> of auto.commit.enable? Also, if you look at the > > >> request log, what's the offset in the fetch request from this > consumer? > > >> Thanks, > > >> Jun > > >> > > >> > > >> On Tue, Feb 11, 2014 at 10:07 PM, Arjun <ar...@socialtwist.com> > wrote: > > >> > > >> The topic name is correct, the o/p of the ConsumerOffserChecker is > > >>> > > >>> arjunn@arjunn-lt:~/Downloads/Kafka0.8/new/kafka_2.8.0-0.8.0$ > > >>> bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --group > group1 > > >>> --zkconnect 127.0.0.1:2181,127.0.0.1:2182,127.0.0.1:2183 --topic > > >>> taf.referral.emails.service > > >>> Group Topic Pid Offset logSize > > >>> Lag Owner > > >>> group1 taf.referral.emails.service 0 2 4 > 2 > > >>> group1_arjunn-lt-1392133080519-e24b249b-0 > > >>> group1 taf.referral.emails.service 1 2 4 > 2 > > >>> group1_arjunn-lt-1392133080519-e24b249b-0 > > >>> > > >>> thanks > > >>> Arjun Narasimha Kota > > >>> > > >>> > > >>> > > >>> > > >>> On Wednesday 12 February 2014 10:21 AM, Jun Rao wrote: > > >>> > > >>> Could you double check that you used the correct topic name? If so, > > >>>> could > > >>>> you run ConsumerOffsetChecker as described in > > >>>> https://cwiki.apache.org/confluence/display/KAFKA/FAQ and see if > > there > > >>>> is > > >>>> any lag? > > >>>> > > >>>> Thanks, > > >>>> > > >>>> Jun > > >>>> > > >>>> > > >>>> On Tue, Feb 11, 2014 at 8:45 AM, Arjun Kota <ar...@socialtwist.com> > > >>>> wrote: > > >>>> > > >>>> fetch.wait.max.ms=10000 > > >>>> > > >>>>> fetch.min.bytes=128 > > >>>>> > > >>>>> My message size is much more than that. > > >>>>> On Feb 11, 2014 9:21 PM, "Jun Rao" <jun...@gmail.com> wrote: > > >>>>> > > >>>>> What's the fetch.wait.max.ms and fetch.min.bytes you used? > > >>>>> > > >>>>>> Thanks, > > >>>>>> > > >>>>>> Jun > > >>>>>> > > >>>>>> > > >>>>>> On Tue, Feb 11, 2014 at 12:54 AM, Arjun <ar...@socialtwist.com> > > >>>>>> wrote: > > >>>>>> > > >>>>>> With the same group id from the console consumer its working > fine. > > >>>>>> > > >>>>>>> > > >>>>>>> On Tuesday 11 February 2014 01:59 PM, Guozhang Wang wrote: > > >>>>>>> > > >>>>>>> Arjun, > > >>>>>>> > > >>>>>>>> Are you using the same group name for the console consumer and > the > > >>>>>>>> > > >>>>>>>> java > > >>>>>>> > > >>>>>> consumer? > > >>>>>> > > >>>>>>> Guozhang > > >>>>>>>> > > >>>>>>>> > > >>>>>>>> On Mon, Feb 10, 2014 at 11:38 PM, Arjun <ar...@socialtwist.com> > > >>>>>>>> > > >>>>>>>> wrote: > > >>>>>>> > > >>>>>> Hi Jun, > > >>>>>> > > >>>>>>> No its not that problem. I am not getting what the problem is can > > you > > >>>>>>>>> please help. > > >>>>>>>>> > > >>>>>>>>> thanks > > >>>>>>>>> Arjun Narasimha Kota > > >>>>>>>>> > > >>>>>>>>> > > >>>>>>>>> On Monday 10 February 2014 09:10 PM, Jun Rao wrote: > > >>>>>>>>> > > >>>>>>>>> Does > > >>>>>>>>> > > >>>>>>>>> https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ- > > >>>>>>>>>> Whydoesmyconsumernevergetanydata? > > >>>>>>>>>> apply? > > >>>>>>>>>> > > >>>>>>>>>> Thanks, > > >>>>>>>>>> > > >>>>>>>>>> Jun > > >>>>>>>>>> > > >>>>>>>>>> > > >>>>>>>>>> On Sun, Feb 9, 2014 at 10:27 PM, Arjun <ar...@socialtwist.com > > > > >>>>>>>>>> > > >>>>>>>>>> wrote: > > >>>>>>>>> > > >>>>>>>> Hi, > > >>>>>> > > >>>>>>> I started using kafka some time back. I was experimenting with > > 0.8. > > >>>>>>>>>> My > > >>>>>>>>>> > > >>>>>>>>> problem is the kafka is unable to consume the messages. My > > >>>>>>> > > >>>>>>>> configuration > > >>>>>>>>>>> is kafka broker on the local host and zookeeper on the local > > >>>>>>>>>>> host. > > >>>>>>>>>>> > > >>>>>>>>>>> I > > >>>>>>>>>> > > >>>>>>>>> have only one broker and one consumer at present. > > >>>>>> > > >>>>>>> What have I done: > > >>>>>>>>>>> 1) I used the java examples in the kafka src and > > pushed > > >>>>>>>>>>> some > > >>>>>>>>>>> > > >>>>>>>>>>> 600 > > >>>>>>>>>> > > >>>>>>>>> messages to the broker > > >>>>>>> > > >>>>>>>> 2) I used the console consumer to check weather the > > >>>>>>>>>>> messages > > >>>>>>>>>>> > > >>>>>>>>>>> are > > >>>>>>>>>> > > >>>>>>>>> there in the broker or not. Console consumer printed all 600 > > >>>>>>> > > >>>>>>>> messages > > >>>>>>>>>> > > >>>>>>>>> 3) Now i used the java Consumer code, and tried to get > > >>>>>> those > > >>>>>> > > >>>>>>> messages. This is not printing any messages. It just got stuck > > >>>>>>>>>>> > > >>>>>>>>>>> When was it working earlier: > > >>>>>>>>>>> -When i tried with three brokers and three consumers > > in > > >>>>>>>>>>> the > > >>>>>>>>>>> > > >>>>>>>>>>> same > > >>>>>>>>>> > > >>>>>>>>> machine, with the same configuration it worked fine. > > >>>>>>> > > >>>>>>>> -I changed the properties accordingly when i tried to > > make > > >>>>>>>>>>> > > >>>>>>>>>>> it > > >>>>>>>>>> > > >>>>>>>>> work > > >>>>>> > > >>>>>>> with one broker and one consumer > > >>>>>>>>>>> > > >>>>>>>>>>> What does log say: > > >>>>>>>>>>> - attaching the logs even > > >>>>>>>>>>> > > >>>>>>>>>>> If some one points me where I am doing wrong it would be > > helpful. > > >>>>>>>>>>> > > >>>>>>>>>>> Thanks > > >>>>>>>>>>> Arjun Narasimha Kota > > >>>>>>>>>>> > > >>>>>>>>>>> > > >>>>>>>>>>> > > >>>>>>>>>>> > > >>>>>>>>>>> > > >>>>>>>>>>> > > > > > >
