Java Consumer API

2015-04-30 Thread Mohit Gupta
Hello, Kafka documentation ( http://kafka.apache.org/documentation.html#producerapi ) suggests using only Producer from kafka-clients ( 0.8.2.0 ) and to use Consumer from the packaged scala client. I just want to check once if the Consumer API from this client is ready for production use. -- Be

Re: Java Consumer API

2015-05-01 Thread Mohit Gupta
ok. thanks. On Fri, May 1, 2015 at 10:00 AM, Aditya Auradkar < aaurad...@linkedin.com.invalid> wrote: > It'll be officially ready only in version 0.9. > > Aditya > > ________ > From: Mohit Gupta [success.mohit.gu...@gmail.com] > Sen

Re: New Producer Async - Metadata Fetch Timeout

2015-05-12 Thread Mohit Gupta
afka producer with application, when i try to shutdown > > >all kafka broker (preparing for prod env) I notice that 'send' method is > > >blocking. > > > > > >Is new producer fetch metadata not async? > > > > > >Rendy > > > > > > > -- > -Regards, > Mayuresh R. Gharat > (862) 250-7125 > -- Best Regards, Mohit Gupta

Re: New Producer Async - Metadata Fetch Timeout

2015-05-13 Thread Mohit Gupta
tation internals. > >> >Given a message and its delivery constraints (produce retry count and > >> >timeout) the producer > >> >should hide any temporal failures until the message is succesfully > >> >delivered, a permanent > >> >error is encoun

Re: New Producer Async - Metadata Fetch Timeout

2015-05-13 Thread Mohit Gupta
; > On Wed, May 13, 2015 at 4:06 AM, Mohit Gupta < > success.mohit.gu...@gmail.com> > wrote: > > > Thanks Jiangjie. This is helpful. > > > > Adding to what you have mentioned, I can think of one more scenario which > > may not be very rare. > >

New Producer API Design

2015-05-13 Thread Mohit Gupta
this defeat the purpose of using generics in the producer? Specific to our use case, we have multiple types of messages, where each message type can have multiple custom serializers. And, a message can be pushed into mulitple topics with different serialization. -- Best Regards, Mohit Gupta

Re: New Producer API Design

2015-05-14 Thread Mohit Gupta
that could still be ser-/de- by the single producer. > > Guozhang > > On Wed, May 13, 2015 at 10:03 AM, Mohit Gupta < > success.mohit.gu...@gmail.com > > wrote: > > > Hello, > > > > I've a question regarding the design of the new Producer API. > &

Impact of Zookeeper Unavailability on Running Producers/Consumers

2015-07-30 Thread Mohit Gupta
mpact on the system. For producers, we see no impact where as for consumers just that their offsets are not getting committed. Also, once the zookeeper is up, consumer offsets should get updated to their proper value. It it correct? Thanks -- Best Regards, Mohit Gupta