Consumer doesn't start picking existing messages from topic until new data is added

.5 . Kafka-Settings are default , except that i the partitions for each topic are set to 1. Please help me out. Thanks Tarang Dawer

Re: Consumer doesn't start picking existing messages from topic until new data is added

Thanks Bruno that fixed it..!! On Thu, Oct 17, 2013 at 6:47 PM, Bruno D. Rodrigues < bruno.rodrig...@litux.org> wrote: > try this, not sure if it would help though > > props.put("auto.offset.reset", "smallest"); > > A 17/10/2013, às 14:13, Ta

Consumer not consuming for 1st time

confused with the consumer behaviour. could somebody please help me out as to how and where am i going wrong ? Thanks & Regards Tarang Dawer

Re: Consumer not consuming for 1st time

ent.java:766) at org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:675) ... 16 more On Thu, Nov 21, 2013 at 9:58 PM, Jun Rao wrote: > When it doesn't consume which offset is in the fetch request? You can find > out from the request log in the broker. > > Thanks, > > Jun > >

Re: Consumer not consuming for 1st time

10:02 PM, Guozhang Wang wrote: > Hi Tarang, > > Could you check if there are any exceptions in the consumer logs when it > does not consume? > > Guozhang > > > On Thu, Nov 21, 2013 at 5:17 AM, Tarang Dawer >wrote: > > > Hello > > > &

Re: Consumer not consuming for 1st time

sing the zookeeper that comes along with the kafka package. also tried it with zookeeper 3.4.5, but again to no effect. On Fri, Nov 22, 2013 at 12:05 PM, Tarang Dawer wrote: > Hi Guozhang > > Didn't get any exceptions in the consumer log if the consumer doesn't > consume.

Re: Consumer not consuming for 1st time

any offset in ZK. > > Thanks, > > Jun > > > On Thu, Nov 21, 2013 at 10:31 PM, Tarang Dawer >wrote: > > > Hi Jun > > > > I tried the ConsumerOffsetChecker script for checking the offsets > > > > but there also , got an exception , with no inf

Re: Consumer not consuming for 1st time

latest code from the 0.8 branch, you should be able to > start > > the consumer before a topic is created. > > > > Thanks, > > > > Jun > > > > > > On Sun, Nov 24, 2013 at 8:14 PM, Tarang Dawer > >wrote: > > > > > okay > &

Consumer not able to create message streams

thing happens only a select couple of times , i.e 2 or 3 times out of 10, and for rest of the times, the consumer starts fine. Is there some property configuration that i may have been missing, that's causing this inconsistent behaviour ? Any guidance would be of great help. Thanks Tarang Dawer

Re: Consumer not able to create message streams

tal 68288K, used 0K [0xf9c0, 0xfdeb, 0xfdeb) object space 68288K, 0% used [0xf9c0,0xf9c0,0xfdeb) PSPermGen total 29888K, used 29878K [0xf4a0, 0xf673, 0x0000f9c00000) object space 29888K, 99% us

Re: Consumer not able to create message streams

Hi Jun please find the consumer thread dump in my previous reply. On Fri, Dec 6, 2013 at 3:27 PM, Tarang Dawer wrote: > Full thread dump Java HotSpot(TM) 64-Bit Server VM (20.8-b03 mixed mode): > > "DestroyJavaVM" prio=10 tid=0x7feb18006800 nid=0xcc2 wai

zkClient version with Kafka 0.8 & scala-library 2.8.0

Hi which dependency version should i use with kafka 0.8 , 0.1 0.2 or 0.3 ? com.101tec zkclient Also, is this groupID correct or should i use zkClient dependency with groupId

zkClient dependency version with kafka 0.8

Hi Which dependency & version of zkClient , is recommended to be used with kafka 0.8 , scala-library 2.8.0 ? I see 2 dependencies for zkClient, 1.

Re: zkClient version with Kafka 0.8 & scala-library 2.8.0

Please ignore this email, got submitted accidently.

Re: zkClient dependency version with kafka 0.8

Hi Which dependency& version of zkClient , is recommended to be used with kafka 0.8 , scala-library 2.8.0 ? I see 2 dependencies for zkClient, 1. com.github.sgroschupf zkclient 0.1 2 . com.101tec zkclient 0.3 Thanks Tarang Dawer

Re: Consumer not able to create message streams

e thread dump though. Are you sure > it's stuck there? > > Thanks, > > Jun > > > On Fri, Dec 6, 2013 at 1:58 AM, Tarang Dawer > wrote: > > > Hi Jun > > please find the consumer thread dump in my previous reply. > > > > > > On Fri, De

Manual Partition-wise Offset Management

Hi All Can we manage partition-offset commits separately instead of a consumerConnector.commitOffsets() (commits offsets of all the related broker partitions simultaneously) call ?