According to https://engineering.gnip.com/kafka-async-producer/ There is one ProducerSendThread per broker. Is it changed from 0.8.2 ? to use single send thread irrespective of broker or partitions.
On Mon, Jun 29, 2015 at 11:27 PM, Guozhang Wang <wangg...@gmail.com> wrote: > Hi Shushant, > > The number of ProducerSendThread will be always one, regardless of the > number of destination brokers, or the number of partitions. > > Guozhang > > On Mon, Jun 29, 2015 at 9:38 AM, Shushant Arora <shushantaror...@gmail.com > > > wrote: > > > Hi > > > > Does kafka async producer creates thread(ProducerSendThread) in producer > > memory based on no number of partitions or brokers in kafka cluster to > > which it will write. > > > > If my cluster had 1000 partitions does each producer will have 1000 > threads > > running always ? > > > > > > -- > -- Guozhang >
