Here is a good doc to describe how to choose the right number of partitions
http://www.confluent.io/blog/how-to-choose-the-number-of-topicspartitions-in-a-kafka-cluster/ On Fri, Sep 4, 2015 at 10:08 PM, Jörg Wagner <joerg.wagn...@1und1.de> wrote: > Hello! > > Regarding the recommended amount of partitions I am a bit confused. > Basically I got the impression that it's better to have lots of partitions > (see information from linkedin etc). On the other hand, a lot of > performance benchmarks floating around show only a few partitions are being > used. > > Especially when considering the difference between hdd and ssds and also > the amount thereof, what is the way to go? > > In my case, I seem to have the best stability and performance issues with > few partitions *per hdd*, and only one io thread per disk. > > What are your experiences and recommendations? > > Cheers > Jörg > -- Regards, Tao
