Re: latency - how to reduce?

What instance types are you using in EC2? Are the drives EBS? On 1/5/15 11:06 PM, Shlomi Hazan wrote: Will do. What did you have in mind? just write a big file to disk and measure the time it took to write? maybe also read back? using specific API's? Apart from the local Win machine case, are yo

Re: kafka-web-console goes down regularly

I saw performance issues with the web console whenever using a large number of partitions (1000 partitions). On 2/3/15 12:09 PM, Sa Li wrote: Hi, All I am currently using kafka-web-console to monitor the kafka system, it get down regularly, so I have to restart it every few hours which is kind

Re: Kafka on AWs EMR

EMR is a product optimized for elastic scaling of clusters - using amazon's pre-defined AMIs. Hadoop and Spark work well on this, but not so much Kafka, which isn't so easy to automatically add/remove nodes from. The best bet is still to use EC2 with your own Kafka AMIs or predefined third party on

Re: How to use kafka as flume source.

The author may or may not have upgraded the project to be compatible with 0.8.1. You could message the author directly to ask. On Sun, Aug 3, 2014 at 6:53 AM, rafeeq s wrote: > Thanks. > But above link example uses flume-ng to > communicate with *kafka 0.7,2 <