Hi Jay, Yes, we are producing from single process/jvm.
>From docs "The producer will attempt to batch records together into fewer requests whenever multiple records are being sent to the same partition." If I understand correctly, batching happens at topic/partition level, not at Node level. right? If yes, then both (single producer for all topics , separate producer for each topic) approaches may give similar performance. On Fri, Apr 24, 2015 at 9:29 PM, Jay Kreps <jay.kr...@gmail.com> wrote: > If you are talking about within a single process, having one producer is > generally the fastest because batching dramatically reduces the number of > requests (esp using the new java producer). > -Jay > > On Fri, Apr 24, 2015 at 4:54 AM, Manikumar Reddy < > manikumar.re...@gmail.com> > wrote: > > > We have a 2 node cluster with 100 topics. > > should we use a single producer for all topics or create multiple > > producers? > > What is the best choice w.r.t network load/failures, node failures, > > latency, locks? > > > > Regards, > > Manikumar > > >
