Re: kafka async producer takes a lot of cpu

2014-12-15 Thread Neha Narkhede
The stack trace you showed shouldn't be going beyond the isDebugEnabled() check if your log4j properties is configured at a higher log level. Regarding your producer dropping messages, have you checked the produce metrics ("kafka.network":name={Produce-TotalTimeMs",type="RequestMetrics") on the bro

Re: kafka async producer takes a lot of cpu

2014-12-14 Thread Rajiv Kurian
I'll try it and let you guys know. Is there anything that comes to mind from these log messages though? Why would there be so many log messages? Would you suggest doing something else to find out why things are working so poorly? I am worried about making the risky transition to the beta producer c

Re: kafka async producer takes a lot of cpu

2014-12-14 Thread Neha Narkhede
Thanks for reporting the issue, Rajiv. Since we are actively phasing out the old client, it will be very helpful to know what the behavior on the new client is. On Fri, Dec 12, 2014 at 8:12 PM, Rajiv Kurian wrote: > > I am using the kafka java api async client (the one that wraps the Scala > cli