Re: Kafka-Storm: troubleshooting low R/W throughput

2015-03-22 Thread Manu Zhang
Hi Emmanuel, You can firstly run a kafka producer perf (bin/kafka-producer-perf-test.sh) test with your storm consumers and kafka consumer perf (bin/ kafka-consumer-perf.test.sh) test with your own producers respectively to see if the bottleneck is really in kafka. Thanks, Manu Zhang On Mon, Mar

Re: Kafka-Storm: troubleshooting low R/W throughput

2015-03-22 Thread Harsha
Hi Emmanuel,        Can you post your kafka server.properties and in your producer are your distributing your messages into all kafka topic partitions. --  Harsha On March 20, 2015 at 12:33:02 PM, Emmanuel (ele...@msn.com) wrote: Kafka on test cluster:  2 Kafka nodes, 2GB, 2CPUs 3 Zookeeper no