Hi Emmanuel,
You can firstly run a kafka producer perf (bin/kafka-producer-perf-test.sh)
test with your storm consumers and kafka consumer perf (bin/
kafka-consumer-perf.test.sh) test with your own producers respectively to
see if the bottleneck is really in kafka.
Thanks,
Manu Zhang
On Mon, Mar
Hi Emmanuel,
Can you post your kafka server.properties and in your producer are your
distributing your messages into all kafka topic partitions.
--
Harsha
On March 20, 2015 at 12:33:02 PM, Emmanuel (ele...@msn.com) wrote:
Kafka on test cluster:
2 Kafka nodes, 2GB, 2CPUs
3 Zookeeper no
hi, thanks for the reply.
I tried the solution although it is not working I am getting the same
Exception.
here's the output of my: >> mvn dependency:tree | grep "scala"
[INFO] | +- org.scala-lang:scala-compiler:jar:2.9.2:compile
[INFO] +- org.scala-lang:scala-library:jar:2.9.2:compile
I don't
it's possible you have some other dependency using an earlier version of
Scala. A common one to check for when using Kafka is jline 0.9.94, which
comes through the zookeeper 3.3.4 dependency included with
kafka_2.9.2-0.8.1 and has more than one dependency that uses scala 2.8.x.
If this is where it
Cool. Thanks for sharing. I added it to our ecosystem wiki.
-Neha
On Fri, May 23, 2014 at 8:02 AM, Michael G. Noll <
michael+ka...@michael-noll.com> wrote:
> Hi everyone,
>
> to sweeten the upcoming long weekend I have released code examples that
> show how to integrate Kafka 0.8+ with Storm 0.
Hi,
regarding ordering issue there are ways to avoid strict dependency on
processing order as discussed in this talk:
http://www.youtube.com/watch?v=ZIzqIzXhTaA by Erik Onnen from Urban
Airship.
On 1 January 2014 18:05, S Ahmed wrote:
> I have briefly looked at storm, but just a quick question,
If your task is completely serial you can still use Kafka and storm but you are
limited in the number of workers that can apply whatever data transformation
you need serialized. Basically you can use one consumer reading one Kafka
partition and one storm worker being fed by the one Kafka consume
