RE: Kafka Performance Tuning

2014-04-25 Thread Yashika Gupta
Timothy, I checked out https://issues.apache.org/jira/browse/KAFKA-1124 So, I created the topic manually and re-ran my test and has enabled log4j properties. There are no ERROR logs in controller and state change logs. And I m still getting the SocketTimeout Exception: 25.04.2014 03:05:10115 WA

Re: Kafka Performance Tuning

2014-04-25 Thread Jun Rao
The socket timeout may be due to this: MaxWait: 6 ms. So, you need to set socket.timeout.ms in consumer config (defaults to 30 secs) to be larger than 60 secs since your fetch request could take up to 60 secs. Thanks, Jun On Fri, Apr 25, 2014 at 12:11 AM, Yashika Gupta wrote: > Timothy, >

performance testing data to share

2014-04-25 Thread Bert Corderman
I have been testing kafka for the past week or so and figured I would share my results so far. I am not sure if the formatting will keep in email but here are the results in a google doc...all 1,100 of them https://docs.google.com/spreadsheets/d/1UL-o2MiV0gHZtL4jFWNyqRTQl41LFdM0upjRIwCWNgQ/edit

Re: performance testing data to share

2014-04-25 Thread Jun Rao
Bert, Thanks for sharing. Which version of Kafka were you testing? Jun On Fri, Apr 25, 2014 at 3:11 PM, Bert Corderman wrote: > I have been testing kafka for the past week or so and figured I would share > my results so far. > > > I am not sure if the formatting will keep in email but here a