I really recommend the book "Kafka, the definitive guide" it's really
useful for people running clusters, lots of good advice on tuning, metrics
etc.
Basically, you scale your cluster when you're hitting limits of your most
important resources (to Kafka) on the broker nodes - CPU, network or disk.
Hi,
Many articles exist about running Kafka at scale, but there are fewer
resources for learning when to grow your cluster (e.g. adding a new broker
or upgrading the computer it's running on).
At first, the answer to that seems straightforward - you add a broker if
you want to reduce the amount o