Re: Initializing fetch offsets

2013-02-21 Thread Neha Narkhede
Thank you for the feedback on documentation and also for improving it. That is the best way to have effective documentation. Thanks, Neha On Thu, Feb 21, 2013 at 8:53 AM, Colin Blower wrote: > In the old protocol description the -1 and -2 values are explicitly > mentioned. > https://cwiki.apac

Re: Initializing fetch offsets

2013-02-21 Thread Colin Blower
In the old protocol description the -1 and -2 values are explicitly mentioned. https://cwiki.apache.org/confluence/display/KAFKA/Wire+Format It looks like it had been left out of the new 0.8 docs, however I just added it. https://cwiki.apache.org/confluence/display/KAFKA/A+Guide+To+The+Kafka+P

Re: Initializing fetch offsets

2013-02-21 Thread David Arthur
Yes, I think that section of the protocol guide could be improved. Specifically, it would be useful to explain what the " Time" and "MaxNumberOfOffsets" parameters are used for, as well documenting these two magic numbers (-1 and -2). -David On 2/21/13 12:13 AM, Neha Narkhede wrote: David,

Re: Initializing fetch offsets

2013-02-20 Thread Neha Narkhede
David, The API that you are looking for is OffsetRequest. If you pass in -2 as the value for Time, it will get you the earliest offset available for that partition. If you pass in -1, it will get you the latest offset. You can find more information about the OffsetRequest and OffsetResponse APIs

Initializing fetch offsets

2013-02-20 Thread David Arthur
Is there currently a way to get the latest offset (or close to the latest) for a partition? Is this covered by the Offset API, and if so could someone explain this API a bit? I'd like to write a consumer that can start from 0 (like unix cat) or start from the most recent (like unix tail). Th