Hi,
I am trying to measure throughput of my 3 broker kafka cluster.
I have created a topic with 3 partitions spread equally over the 3 brokers.
Run a producer application to produce messages. producer application has 3
thread (one for each partition) to produce.
Then i increased the number of parti
At LinkedIn, some of the high volume topics are configured with more than
1 partition per broker. Having more partitions increases I/O parallelism
for writes and also increases the degree of parallelism for consumers
(since partition is the unit for distributing data to consumers). On the
other ha
All,
I was re-reading this:
https://cwiki.apache.org/confluence/display/KAFKA/Operations and noticed that
the number of partitions is 1. Is this accurate? In our environment we are
currently running 20+ partitions per topic - with two brokers, the gut feel was
this would speed up our ability to
