Apologies, never mind this. I realize now I've confused Log objects with Topic
Partitions.
So since Log size is constant, number of logs in the log directory is actually
a good criteria.
--
Igor Soarez
On Thu, May 7, 2020, at 4:41 PM, Igor Soarez wrote:
>
> When running Kafka with multiple lo
When running Kafka with multiple log directories
kafka.log.LogManager.getOrCreateLog selects the first available log directory
with the smallest number of topic partitions.
Topic partitions can have different sizes and this policy easily leads to data
imbalances between log directories (or dis
