Re: Issue with async producer

2014-11-06 Thread Jun Rao
uts > on it.Is there anything that needs to be taken care of in this case? > > Regards, > Dev > > From: Devendra Tagare > Sent: Tuesday, November 04, 2014 10:02 AM > To: users@kafka.apache.org > Cc: Devendra Tagare > Subject: Issue wi

RE: Issue with async producer

2014-11-06 Thread Devendra Tagare
ucer but were not able to enforce the timeouts on it.Is there anything that needs to be taken care of in this case? Regards, Dev From: Devendra Tagare Sent: Tuesday, November 04, 2014 10:02 AM To: users@kafka.apache.org Cc: Devendra Tagare Subject: Issue wi

Re: Issue with async producer

2014-11-04 Thread Jun Rao
Which version of Kafka are you using? Is the broker I/O or network saturated? If so, that will limit the throughput that each producer can achieve. If not, using a larger number messages per batch and/or enabling producer side compression typically improves the producer throughput. Thanks, Jun O

Issue with async producer

2014-11-03 Thread Devendra Tagare
Hi, We are using an async producer to send data to kafka. The load the sender handles is around 250 rps ,the size of a message is around 25K. The configs used in the producer are : request.required.acks=0 producer.type=async batch.num.messages=10 topic.metadata.refresh.interval.ms=3 queue.