You should also check out Becket Qin’s presentation on producer performance tuning on YouTube. Both these items should give you all positives and negatives of having many/less portions.
Thanks, On Sat, 26 Oct 2019 at 09:19, Manasvi Gupta <fatbab...@gmail.com> wrote: > > https://www.confluent.io/blog/how-choose-number-topics-partitions-kafka-cluster > > This might be useful for you. > > On Sat 26 Oct, 2019, 12:40 PM Jungyeol Lee, <jungy...@skelterlabs.com> > wrote: > > > I'm running a kafka cluster running only one broker with GCP > n1-standard-2 > > instance. > > I configured the number of partitions to 1000, but it is suffering from > > running a broker on startup. It seems that it needs much more time for > > topic creation. So, what I did is just set the smaller number of > partitions > > which is now 32. Everything works okay for now. Is this normal behavior > or > > performance? Or, are there any guidelines on setting the number of > > partitions? > > > > Best, > > -- > > >
