All, I was re-reading this: https://cwiki.apache.org/confluence/display/KAFKA/Operations and noticed that the number of partitions is 1. Is this accurate? In our environment we are currently running 20+ partitions per topic - with two brokers, the gut feel was this would speed up our ability to read from many threads in a consumer group. What I am lacking is a true understanding of the pros/cons of having more partitions on a given broker, what are they? Are there guidelines to follow in setting up the partitions?
Thanks in advance, Andrew