Re: Adding replicas to existing topic cause data loss in some partitions

sorry, I didn't pay attention to these log. I did it by running a script in the night, and received feedback in the morning, I found the server log overflow by printing OutOfRange exception, so didn't catch any clue. I'll take care next time. Anyway, thanks a lot. On Mon, Nov 10, 2014 at 9:59 AM,

Re: Adding replicas to existing topic cause data loss in some partitions

Any error in the controller/state-change log when you increased the replication factor? If you describe those topics, are both replicas in ISR? The answers to those questions will help us understand whether this is a broker side or consumer-side issue. Thanks, Jun On Thu, Nov 6, 2014 at 11:56 PM

Adding replicas to existing topic cause data loss in some partitions

I have a kafka cluster, every topic in it has only one replica. Recently I extend every topic with 2 replicas. Most topics work fine, but some large topics have some problems with part of partitions. Consumer throw offset OutOfRange exception, the fact is consumer request offset is bigger than the

Re: Adding replicas to existing topic

Good to hear! We would like to add a tool to increase replication factor in the future, so this is just a stop-gap :) On Tue, Mar 25, 2014 at 9:49 AM, Marc Labbe wrote: > ... and it works like a charm :-) > > > On Tue, Mar 25, 2014 at 12:28 PM, Marc Labbe wrote: > > > Great! I'll give it a try

Re: Adding replicas to existing topic

... and it works like a charm :-) On Tue, Mar 25, 2014 at 12:28 PM, Marc Labbe wrote: > Great! I'll give it a try. > > cheers, > marc > > > On Fri, Mar 21, 2014 at 1:10 PM, Neha Narkhede wrote: > >> Marc, >> >> I included the notes on increasing replication factor in the docs. It >> seems >> to

Re: Adding replicas to existing topic

Great! I'll give it a try. cheers, marc On Fri, Mar 21, 2014 at 1:10 PM, Neha Narkhede wrote: > Marc, > > I included the notes on increasing replication factor in the docs. It seems > to work fine locally though I haven't tested it in a production setting. > Here you go - > > http://kafka.apach

Re: Adding replicas to existing topic

Marc, I included the notes on increasing replication factor in the docs. It seems to work fine locally though I haven't tested it in a production setting. Here you go - http://kafka.apache.org/081/documentation.html#basic_ops_increase_replication_factor Thanks, Neha On Wed, Mar 19, 2014 at 11:1

Re: Adding replicas to existing topic

Ya, this is one tool that has been dragging for a bit too long and is not available in 0.8.1. There is a way to use the partition reassignment tool to achieve the same objective (by reassigning a partition from replicas r1

Re: Adding replicas to existing topic

done, https://issues.apache.org/jira/browse/KAFKA-1313 Can you expand on the hacky method? If could fix this before 0.8.2 is released, it'd be great. thanks marc On Wed, Mar 19, 2014 at 12:27 PM, Neha Narkhede wrote: > Ya, this is one tool that has been dragging for a bit too long and is not >

Adding replicas to existing topic

Hi, I have a few topics that were created a while ago with default parameters with only 1 replica per partition. I am wondering if there is a way to add replicas to existing partitions of an existing topic. I didn't see anything obvious from the tools. marc