Yes you can increase on the fly using the kafka-topics script. As
Sharninder mentioned this could break applications that have partitioning
logic.
./kafka-topics ‹alter ‹partitions
-Clark
chask...@linkedin.com
https://www.linkedin.com/in/clarkhaskins
There is no place like 127.0.0.1
On 7/26
You can add partitions at runtime but not delete (AFAIK, someone correct me
if I'm wrong). The reason it's usually discouraged is that when partitions
get added to a topic, the message assignment changes and if you're
application depends on some partitioning logic, that will fail.
--
Sharninder
We do support adding partitions in an existing topic.
Thanks,
Jun
On Fri, Jul 25, 2014 at 1:59 PM, Kashyap Mhaisekar
wrote:
> Great. Thanks all. But there is no easy way to change partitions once the
> topic is created right? I run kafka 0.8.2 and its a difficult job to
> reassign partitions.
Great. Thanks all. But there is no easy way to change partitions once the
topic is created right? I run kafka 0.8.2 and its a difficult job to
reassign partitions.
On Fri, Jul 25, 2014 at 3:10 PM, Clark Haskins <
chask...@linkedin.com.invalid> wrote:
> You can have more partitions than machines
You can have more partitions than machines in the cluster, you cannot
however have a replication factor that is great than the number of
machines in the cluster.
You could easily have a topic with 100 partitions on a 3 node cluster.
-Clark
Clark Elliott Haskins III
LinkedIn DDS Site Reliability
Brokers can host multiple partitions for the same topic without any problems.
Philip
-
http://www.philipotoole.com
On Wednesday, July 23, 2014 2:15 PM, Kashyap Mhaisekar
wrote:
HI,
Is the maximum no. of partitions for a topic dependent on the no. of
HI,
Is the maximum no. of partitions for a topic dependent on the no. of
machines in a kafka cluster?
For e.g., if I have 3 machines in a cluster, can I have 5 partitions with a
caveat that one machine can host multiple partitions for a given topic?
Regards,
Kashyap
