One ProducerSendThread is always the case for producer, but inside the thread there is one SyncProducer for each destination broker. I think that blog may mis-understand the design a bit.
Guozhang On Tue, Jun 30, 2015 at 1:45 AM, Shushant Arora <shushantaror...@gmail.com> wrote: > According to > https://engineering.gnip.com/kafka-async-producer/ > There is one ProducerSendThread per broker. Is it changed from 0.8.2 ? to > use single send thread irrespective of broker or partitions. > > > On Mon, Jun 29, 2015 at 11:27 PM, Guozhang Wang <wangg...@gmail.com> > wrote: > > > Hi Shushant, > > > > The number of ProducerSendThread will be always one, regardless of the > > number of destination brokers, or the number of partitions. > > > > Guozhang > > > > On Mon, Jun 29, 2015 at 9:38 AM, Shushant Arora < > shushantaror...@gmail.com > > > > > wrote: > > > > > Hi > > > > > > Does kafka async producer creates thread(ProducerSendThread) in > producer > > > memory based on no number of partitions or brokers in kafka cluster to > > > which it will write. > > > > > > If my cluster had 1000 partitions does each producer will have 1000 > > threads > > > running always ? > > > > > > > > > > > -- > > -- Guozhang > > > -- -- Guozhang
