[
https://issues.apache.org/jira/browse/KAFKA-2106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
chenshangan updated KAFKA-2106:
-------------------------------
Attachment: KAFKA-2106.3
implement a global balance among the cluster, which will destroy the original
partition assignment algo. But, the cluster can reach to a balanced state
eventually.
It first divide all the topic into two groups: big topics and small topics.
Number of parititions of big topics is bigger than number of brokers, while
small topics are the opposite. It will guarantee that partitions of big topic
is distributed evenly in the cluster. When it comes to some topics, do not
constraint absolute even distribution as big topics.
> Partition balance tool between borkers
> --------------------------------------
>
> Key: KAFKA-2106
> URL: https://issues.apache.org/jira/browse/KAFKA-2106
> Project: Kafka
> Issue Type: New Feature
> Components: admin
> Affects Versions: 0.8.3
> Reporter: chenshangan
> Attachments: KAFKA-2106.3, KAFKA-2106.patch, KAFKA-2106.patch.2
>
>
> The default partition assignment algorithm can work well in a static kafka
> cluster(number of brokers seldom change). Actually, in production env, number
> of brokers is always increasing according to the business data. When new
> brokers added to the cluster, it's better to provide a tool that can help to
> move existing data to new brokers. Currently, users need to choose topic or
> partitions manually and use the Reassign Partitions Tool
> (kafka-reassign-partitions.sh) to achieve the goal. It's a time-consuming
> task when there's a lot of topics in the cluster.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
