Re: Issues with Kafka async producer's enqueue timeout

2014-11-21 Thread Jun Rao
Ok, then your understanding is correct. If the queue is full then the enqueue operation should result in a kafka.common.QueueFullException in 20 ms. Not sure why this is not happening since in the code, we simply call queue.offer() with the timeout. It could be due to contention. Do you have lots o

RE: Issues with Kafka async producer's enqueue timeout

2014-11-20 Thread Devendra Tagare
Hi, We are using an async producer. The producer properties are: producer.type= async queue.enqueue.timeout.ms=20 send.buffer.bytes=1024000 topic.metadata.refresh.interval.ms=3 Please find more details in the mail thread below. Regards, Dev From: Devendra

Re: Issues with Kafka async producer's enqueue timeout

2014-11-20 Thread Jun Rao
queue.enqueue.timeout.ms only applies if the producer is configured in async mode. Thanks, Jun On Thu, Nov 20, 2014 at 5:01 AM, Devendra Tagare < devendra.tag...@pubmatic.com> wrote: > Hi, > > We are using an async producer to send data to a kafka cluster.The event > rate at peak is around 250