Also if you use HEAD, you can create more partitions at runtime, you just need dynamic partitioner class I think
On Thu, Nov 14, 2013 at 7:23 AM, Neha Narkhede <neha.narkh...@gmail.com>wrote: > There is no way to delete topics in Kafka yet. You can add partitions to > existing topics, but you may have to use 0.8 HEAD since we have fixed a few > bugs on the consumer. > > You can read about add partitions here > > https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools#Replicationtools-5.AddPartitionTool > > Thanks, > Neha > On Nov 14, 2013 5:56 AM, "Yu, Libo" <libo...@citi.com> wrote: > > > Hi team, > > > > We are using beta1. I am going to delete all topics and create them with > > more partitions. > > But I don't want to lose any messages. > > > > Assume the consumers are online all the time for the following steps. The > > consumer's > > auto.offset.reset is set to largest. > > > > 1 stop publishing to the brokers. > > 2 wait until all N messages on the brokers have been consumed > > 3 delete all topics. That includes deleting the log files and > > /brokers/topics/mytopic and > > /consumers/myusergroup/owners/mytopic and > > /consumers/myusergroup/offsets/mytopic > > 4 recreate all the topics with more partitions. > > 5 start the brokers > > 6 resume publishing to the brokers > > > > When a consumer tries to get the next message from a newly created topic, > > will the OutOfRange > > Exception will reset the offset to 0 in this case? > > Thanks, > > > > Libo > > > > >
