Re: Review for the new consumer APIs

2014-05-06 Thread Neha Narkhede
1) We would like to find out what is latest message per partition that current consumer is connected? I'm not sure I understood what you meant by "connected". The new consumer will expose the position()

Re: Review for the new consumer APIs

2014-05-05 Thread Bhavesh Mistry
Hi Neha, How will new Consumer help us with implementing following use case? We have heartbeat as one of topics and all application servers publish metric to this topic. We have to meet near real-time consume SLA (less than 30 seconds). 1) We would like to find out what is latest message per

Re: Review for the new consumer APIs

2014-04-12 Thread Neha Narkhede
Why cant we pass a callback in subscribe itself? Mainly because it will make the processing kind of awkward since you need to access the other consumer APIs while processing the messages. Your suggestion does point out a problem with the poll() API though. Here is the initial proposal of the poll(

Re: Review for the new consumer APIs

2014-04-08 Thread pushkar priyadarshi
Was trying to understand when we have subscribe then why poll is a separate API.Why cant we pass a callback in subscribe itself? On Mon, Apr 7, 2014 at 9:51 PM, Neha Narkhede wrote: > Hi, > > I'm looking for people to review the new consumers APIs. Patch is posted at > https://issues.apache.org/

Re: Review for the new consumer APIs

2014-04-07 Thread Guozhang Wang
Thanks Neha, will do that today. Guozhang On Mon, Apr 7, 2014 at 9:21 AM, Neha Narkhede wrote: > Hi, > > I'm looking for people to review the new consumers APIs. Patch is posted at > https://issues.apache.org/jira/browse/KAFKA-1328 > > Thanks, > Neha > -- -- Guozhang

Review for the new consumer APIs

2014-04-07 Thread Neha Narkhede
Hi, I'm looking for people to review the new consumers APIs. Patch is posted at https://issues.apache.org/jira/browse/KAFKA-1328 Thanks, Neha