Re: How to fetch old messages from kafka

2015-02-09 Thread Snehalata Nagaje
represented by one offset? Thanks, Snehalata - Original Message - From: "Mayuresh Gharat" To: users@kafka.apache.org Sent: Friday, February 6, 2015 3:48:42 AM Subject: Re: How to fetch old messages from kafka If you see the code for getOffsetsBefore() : /** * Get a list of val

Re: How to fetch old messages from kafka

2015-02-05 Thread Joel Koshy
riginal Message - > From: gharatmayures...@gmail.com > To: users@kafka.apache.org > Sent: Wednesday, February 4, 2015 11:24:46 AM > Subject: Re: How to fetch old messages from kafka > > In that case you will have to maintain the offsets consumed and reset the > offsets in c

Re: How to fetch old messages from kafka

2015-02-05 Thread Mayuresh Gharat
es from any given valid offset returned from > getOffsetBefore(). > > is this correct approach? > > Thanks, > Snehalata > > - Original Message - > From: gharatmayures...@gmail.com > To: users@kafka.apache.org > Sent: Wednesday, February 4, 2015 11:24:46 AM >

Re: How to fetch old messages from kafka

2015-02-04 Thread Snehalata Nagaje
correct approach? Thanks, Snehalata - Original Message - From: gharatmayures...@gmail.com To: users@kafka.apache.org Sent: Wednesday, February 4, 2015 11:24:46 AM Subject: Re: How to fetch old messages from kafka In that case you will have to maintain the offsets consumed and reset the

Re: How to fetch old messages from kafka

2015-02-03 Thread gharatmayuresh15
In that case you will have to maintain the offsets consumed and reset the offsets in case you need to consume from past. For example, suppose you have a userA for which you have a partitionA for topic TopicA. Each page shown to user increments the offset by 10. You have consumed till offset 100

How to fetch old messages from kafka

2015-02-03 Thread Snehalata Nagaje
Hi , We are using kafka for storing messages in chat application. Currently we divided each topic in multiple partitions. each partition stores data for given customer who uses the application. Right now on very first request, application fetches log from kafka from earliest valid offset to