Re: Balancing traffic between multiple directories

2022-10-27 Thread Alex Craig
urce version could have this feature as well? > > Or, is it the idea that opensource version shouldn't be used in a high > > load production environment? > > > > ____ > > 发件人: sunil chaudhari > > 发送时间: 2022年10月27日 3:11 > > 收件

Re: Balancing traffic between multiple directories

2022-10-27 Thread Andrew Grant
; 发送时间: 2022年10月27日 3:11 > 收件人: users@kafka.apache.org > 主题: Re: Balancing traffic between multiple directories > > Hi Lehar, > You are right. There is no better way in open source Kafka. > However confluent has something called as Auto Rebalancing feature. > Can you chec

Re: Balancing traffic between multiple directories

2022-10-26 Thread sunil chaudhari
Hi Lehar, You are right. There is no better way in open source Kafka. However confluent has something called as Auto Rebalancing feature. Can you check if there is free version with this feature? It start balancing of brokers automatically when it see there is uneven distribution of partitions.

Re: Balancing traffic between multiple directories

2022-10-25 Thread Lehar Jain
Hey Andrew, Thanks for the reply. Currently, we are using the same method as you described. Wanted to make sure if there is a better way. It seems there isn't currently. So we will keep using this only. On Tue, Oct 25, 2022 at 7:23 PM Andrew Grant wrote: > Hey Lehar, > > > I don’t think there’

Re: Balancing traffic between multiple directories

2022-10-25 Thread Andrew Grant
Hey Lehar, I don’t think there’s a way to control this during topic creation. I just took a look through https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/admin/AdminUtils.scala and it does appear partition assignment does not account for each broker’s different log directories