Thanks Neha. How can I shutdown the producer? is it ctrl-c? -----Original Message----- From: Neha Narkhede [mailto:[email protected]] Sent: Thursday, December 20, 2012 2:54 PM To: [email protected] Subject: Re: Batch size in producer
> How big should be the batch size? > In production at Linkedin, we use a batch size of 200, which has worked pretty well. > What happens if producer client crashes before batch is full and messages > were still sitting in producer queue? Does it recover those messages when > we restart the producer? > If the producer shuts down, it flushes out the messages in the internal queue. If it crashes, it does not get a chance to do that and there is no good alternative to this. > Are these messages stored in memory or disk? > In memory. Thanks, Neha
