Re: SimpleConsumer fetching the last read offset

2014-10-30 Thread Rajiv Kurian
Got it. Thanks! On Thu, Oct 30, 2014 at 11:40 AM, Joel Koshy wrote: > That is something that you will need to manage manually with the > SimpleConsumer. You can store it in ZK (manually) or a > file/database/other. You can also store it in Kafka if you send an > OffsetCommitRequest > ( > https:/

Re: SimpleConsumer fetching the last read offset

2014-10-30 Thread Joel Koshy
That is something that you will need to manage manually with the SimpleConsumer. You can store it in ZK (manually) or a file/database/other. You can also store it in Kafka if you send an OffsetCommitRequest (https://cwiki.apache.org/confluence/display/KAFKA/A+Guide+To+The+Kafka+Protocol#AGuideToThe

SimpleConsumer fetching the last read offset

2014-10-30 Thread Rajiv Kurian
Does the SimpleConsumer provide any facility to record what offset in a partition was last processed by a consumer? From the example I have seen the use of kafka.api.OffsetRequest.EarliestTime() and kafka.api.OffsetRequest.LatestTime()but nothing that provides consumer -> Set(partition, offset) I