Here's the reassignment json and current "describe" output: https://gist.github.com/davidbirdsong/32cd0c4f49496a6a32e5
In my re-assignment json, I tried to re-assign to 2 when the repl is set to 3. Once I noticed the the completely new node "133" had appeared in the ISR, I tried stopping 224, wiping kafka completely and then brought 224 back up as 224 again. It promptly replicated the topic, but never joined the ISR. How does one move a replica? This is exactly what I'm trying to do. My pattern is a common one. I started with a set of 3 kafka brokers. The load and space is overwhelming them. I'm trying to add new brokers and spread the partitions to new nodes while removing some of the partitions on the old nodes so as to make room. It's the latter that I don't get how to do. I've conflated two issues here mostly due to needing to get this cluster stable again. - reduce replication - remove a partition from a broker, ie. remove the replica they're very distinct actions, but both would help me in the moment On Wed, May 21, 2014 at 8:56 AM, Jun Rao <jun...@gmail.com> wrote: > During the re-assignment, did you move the replica off the old broker? > > Thanks, > > Jun > > > On Wed, May 21, 2014 at 8:21 AM, David Birdsong <david.birds...@gmail.com > >wrote: > > > I did that and so now the topic has 4 replicas for a repl count of 3, but > > only the 'new' replicas exist in the ISR. > > > > The old broker that I want to clear disk space and generally free up > > resources has fully synced a topic that I want to disassociate from it. > > > > Is there a way to do this? > > > > > > On Wed, May 21, 2014 at 7:48 AM, Jun Rao <jun...@gmail.com> wrote: > > > > > We don't have an exact tool for doing this. You may be able to do that > > > through > > > > > > > > > http://kafka.apache.org/documentation.html#basic_ops_increase_replication_factorby > > > specifying fewer replicas. > > > > > > Thanks, > > > > > > Jun > > > > > > > > > On Wed, May 21, 2014 at 1:23 AM, David Birdsong < > > david.birds...@gmail.com > > > >wrote: > > > > > > > Is there a way to reduce the replication count? I'm trying to spread > > > > existing partitions across more brokers, but it's hard to decomm a > > > broker. > > > > Reducing repl count would suffice for now. > > > > > > > > Any tips? > > > > > > > > I'm running a mix of 0.8.1.1 and 0.8.1 (I'm upgrading now.) > > > > > > > > > >
