Re: How to decrease number of replicas

2015-06-18 Thread Guangle Fan
on is rolling restart stuck leaders for each partition, and sent out replica reassignment once again. On Thu, Jun 18, 2015 at 5:37 PM, Guangle Fan wrote: > If I use the same approach to reassign smaller number of replicas to the > same partition, I got this error : > > (0,5,1,6,2,3

Re: How to decrease number of replicas

2015-06-18 Thread Guangle Fan
nt (6) for partition [topic,0] On Thu, Jun 18, 2015 at 5:03 PM, Guangle Fan wrote: > Hi, Folks > > We have an online kafka cluster v0.8.1.1. > After running a partition reassignment script which maps each partition to > 3 replicas. But growth of data is out of my expectation, an

How to decrease number of replicas

2015-06-18 Thread Guangle Fan
Hi, Folks We have an online kafka cluster v0.8.1.1. After running a partition reassignment script which maps each partition to 3 replicas. But growth of data is out of my expectation, and I really need to decrease replicas for each partition to 2 or 1. What's the best way to do this ? Thanks !

Re: .deleted file descriptors

2015-03-02 Thread Guangle Fan
t; [2] http://bugs.java.com/view_bug.do?bug_id=4724038 > [3] http://bugs.java.com/view_bug.do?bug_id=6417205 > > -Jaikiran > > > On Monday 02 March 2015 10:30 AM, Guangle Fan wrote: > >> Slightly different from what I observed. >> >> Broker box has 800GB disk

Re: .deleted file descriptors

2015-03-01 Thread Guangle Fan
e. when Kafka > > decide to clean the logs, it only adds a suffix ".deleted" to the files > > such that it will not be access any more by other Kafka threads. The > actual > > file deletion will be executed later, with period controlled by " > > file.delete

.deleted file descriptors

2015-02-27 Thread Guangle Fan
Hi, After Kafka cleaned .log / .index files based on topic retention. I can still lsof a lot of .index.deleted files. And df shows usage on disk space is accumulated to full. When this happened, just by restarting broker, it will immediately free those disk space. I seems to me kafka after cleani

Re: rebalance brokers

2014-09-29 Thread Guangle Fan
n is only introduced in 0.8, with 0.7 there should not have > leader / follower replicas. Could you verify the version of your Kafka > cluster? > > Guozhang > > On Mon, Sep 29, 2014 at 4:30 PM, Guangle Fan wrote: > > > Hi, All > > > > We have some old kafka node

rebalance brokers

2014-09-29 Thread Guangle Fan
Hi, All We have some old kafka nodes that are still running 0.7. We disable the replica of topics there. Recently we added some node brokers to that cluster, I found new nodes won't got written or read even though it's registered correctly in zookeeper. I think in this case, it's because all the

Join the list

2014-07-15 Thread Guangle Fan
Hi, Could you add me into the mailing list ?