Re: Changing the number of partitions after a topic is created

Thanks Neha, that helps. On Wed, Aug 28, 2013 at 12:59 PM, Neha Narkhede wrote: > The tool you are looking for is described here - > > https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools#Replicationtools-5.AddPartitionCommandTool > . > > Please note that this tool can only increa

Re: Changing the number of partitions after a topic is created

The tool you are looking for is described here - https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools#Replicationtools-5.AddPartitionCommandTool . Please note that this tool can only increase the number of partitions for a topic, there is no tool to reduce the number of partitions y

Re: Changing the number of partitions after a topic is created

Hi Neha, If we set auto.create.topics.enable = true and update num.partitions. New topic get right number of partitions. But existing topics continue to use whatever num.partitions set before. I am asking about the tool that allow existing topic to use updated number of partitions. Thanks, Raja.

Re: Changing the number of partitions after a topic is created

Hi Rajasekar, I'm not sure I fully understood your question. Are you asking about a tool that can increase the number of partitions for a topic? Thanks, Neha On Wed, Aug 28, 2013 at 8:47 AM, Rajasekar Elango wrote: > Hi Jun, > > It's been some time since you last post, is this patch available

Re: Changing the number of partitions after a topic is created

Hi Jun, It's been some time since you last post, is this patch available now. Also we are doing following manual steps to update existing topic to use new partitions. 1) stop all zookeepers 2) stop all kafka brokers 3) clean data dir or zookeepers and kafka 4) start zookeepers and kafka. This in

Re: Changing the number of partitions after a topic is created

We are shooting for providing a patch in a couple of weeks. Thanks, Jun On Mon, Jul 8, 2013 at 10:33 AM, Timothy Chen wrote: > Hi Jun, > > I wonder when will the tool be available? We're very interested in changing > the number of partitions for a topic after creation too. > > Thanks! > > Tim

Re: Changing the number of partitions after a topic is created

Hi Jun, I wonder when will the tool be available? We're very interested in changing the number of partitions for a topic after creation too. Thanks! Tim On Thu, Jul 4, 2013 at 9:06 PM, Jun Rao wrote: > Currently, once a topic is created, the number of partitions can't be > changed. We are wo

RE: Changing the number of partitions after a topic is created

Thanks, Jun. Have a good weekend. Regards, Libo -Original Message- From: Jun Rao [mailto:jun...@gmail.com] Sent: Friday, July 05, 2013 3:08 PM To: users@kafka.apache.org Subject: Re: Changing the number of partitions after a topic is created No. However, you can specify the # of

Re: Changing the number of partitions after a topic is created

operties for 0.8? > There is no documentation about that in the file. > > Regards, > > Libo > > > -Original Message- > From: Jun Rao [mailto:jun...@gmail.com] > Sent: Friday, July 05, 2013 12:06 AM > To: users@kafka.apache.org > Subject: Re: Changing t

RE: Changing the number of partitions after a topic is created

@kafka.apache.org Subject: Re: Changing the number of partitions after a topic is created Currently, once a topic is created, the number of partitions can't be changed. We are working on a tool to allow that. For now, you will have to either use a new topic with more partitions or if you don&#

Re: Changing the number of partitions after a topic is created

Currently, once a topic is created, the number of partitions can't be changed. We are working on a tool to allow that. For now, you will have to either use a new topic with more partitions or if you don't care about messages being consumed in order, you can feed the consumed messages to a separate

Re: Changing the number of partitions after a topic is created

On Thu, Jul 4, 2013 at 12:06 PM, Calvin Lei wrote: > Thanks Phillip. I used the kafka-topic.sh to create the topic to have 1 > partition. Would the changing the server properties still work in this case? I'm not familiar with that script, but server.properties is what matters. Change that and it

Re: Changing the number of partitions after a topic is created

Thanks Phillip. I used the kafka-topic.sh to create the topic to have 1 partition. Would the changing the server properties still work in this case? Also this setting sounds like a global overwrite, correct? regards, Cal On Jul 4, 2013, at 11:49 AM, Philip O'Toole wrote: > If you can pause y

Re: Changing the number of partitions after a topic is created

If you can pause your Producers, simply change the partition count to 10 in the Kafka server properties file, and restart it. If you use the high-level consumer, it will automatically start draining all partitions that exist for a given topic. And our Kafka producers always write to partition -1 f