Re: Consumer not consuming for 1st time

2013-11-29 Thread Tarang Dawer
Thanks , cleared my confusion. On Nov 25, 2013 10:58 PM, "Guozhang Wang" wrote: > Hi Tarang, > > Details about the issue you brought up can be found in KAFKA-1004. > > Guozhang > > > On Mon, Nov 25, 2013 at 7:43 AM, Jun Rao wrote: > > > If you use the latest code from the 0.8 branch, you should

Re: Consumer not consuming for 1st time

2013-11-25 Thread Guozhang Wang
Hi Tarang, Details about the issue you brought up can be found in KAFKA-1004. Guozhang On Mon, Nov 25, 2013 at 7:43 AM, Jun Rao wrote: > If you use the latest code from the 0.8 branch, you should be able to start > the consumer before a topic is created. > > Thanks, > > Jun > > > On Sun, Nov

Re: Consumer not consuming for 1st time

2013-11-25 Thread Jun Rao
If you use the latest code from the 0.8 branch, you should be able to start the consumer before a topic is created. Thanks, Jun On Sun, Nov 24, 2013 at 8:14 PM, Tarang Dawer wrote: > okay > > is it necessary that a topic should be created first before a consumer is > started to listen from tha

Re: Consumer not consuming for 1st time

2013-11-24 Thread Tarang Dawer
okay is it necessary that a topic should be created first before a consumer is started to listen from that topic ? or we can start the consumer 1st before the topic has been created ? On Fri, Nov 22, 2013 at 8:53 PM, Jun Rao wrote: > That error means the consumer has never checkpointed any off

Re: Consumer not consuming for 1st time

2013-11-22 Thread Jun Rao
That error means the consumer has never checkpointed any offset in ZK. Thanks, Jun On Thu, Nov 21, 2013 at 10:31 PM, Tarang Dawer wrote: > Hi Jun > > I tried the ConsumerOffsetChecker script for checking the offsets > > but there also , got an exception , with no information regarding the > of

Re: Consumer not consuming for 1st time

2013-11-22 Thread Tarang Dawer
The data is being produced in the topic, as i can view the topic-partitions directories in the data directory. I also noticed that the above scenario happens only when consumer is first started and later the data is inserted for the first time, but not when data is already present, then it consume

Re: Consumer not consuming for 1st time

2013-11-21 Thread Tarang Dawer
Hi Guozhang Didn't get any exceptions in the consumer log if the consumer doesn't consume. in zookeeper logs got info messages like - [2013-11-22 11:30:04,607] INFO Got user-level KeeperException when processing sessionid:0x1427e5fdbcc type:create cxid:0x92 zxid:0xfffe txntype:unk

Re: Consumer not consuming for 1st time

2013-11-21 Thread Tarang Dawer
Hi Jun I tried the ConsumerOffsetChecker script for checking the offsets but there also , got an exception , with no information regarding the offset. Although when i start the consumer for the second time, it consumed the data, but still same response from the offset checker script. Please find

Re: Consumer not consuming for 1st time

2013-11-21 Thread Guozhang Wang
Hi Tarang, Could you check if there are any exceptions in the consumer logs when it does not consume? Guozhang On Thu, Nov 21, 2013 at 5:17 AM, Tarang Dawer wrote: > Hello > > I am running a kafka 0.8 consumer with the following configuration : - > > fetch.size=10 > zookeeper.session.t

Re: Consumer not consuming for 1st time

2013-11-21 Thread Jun Rao
When it doesn't consume which offset is in the fetch request? You can find out from the request log in the broker. Thanks, Jun On Thu, Nov 21, 2013 at 5:17 AM, Tarang Dawer wrote: > Hello > > I am running a kafka 0.8 consumer with the following configuration : - > > fetch.size=10 > zoo