RE: Kafka load balance strategy

2017-12-29 Thread 赖剑清
t: Friday, December 29, 2017 5:25 PM >To: users@kafka.apache.org >Subject: Re: Kafka load balance strategy > >Can you take a look at KAFKA-5337 ( >https://cwiki.apache.org/confluence/display/KAFKA/KIP-169+-+Lag- >Aware+Partition+Assignment+Strategy) >? > >Cheers > >On

Re: Kafka load balance strategy

2017-12-29 Thread Ted Yu
Can you take a look at KAFKA-5337 ( https://cwiki.apache.org/confluence/display/KAFKA/KIP-169+-+Lag-Aware+Partition+Assignment+Strategy) ? Cheers On Thu, Dec 28, 2017 at 11:17 PM, 赖剑清 wrote: > Hi, all > > I met a problem while using Kafka as a message queue. > > I have 10 consumer servers and 3

Kafka load balance strategy

2017-12-28 Thread 赖剑清
Hi, all I met a problem while using Kafka as a message queue. I have 10 consumer servers and 3 of them have worse performance. In this case, I set my topic with partitions=17, and I hope that 7 powerful consumer servers consume 2 partitions/server while these 3 weaker server consume only one p