Affan, All known problems in the controller are described in the doc linked from https://issues.apache.org/jira/browse/KAFKA-5027.
Thanks, Jun On Mon, Nov 6, 2017 at 11:00 PM, Affan Syed <as...@an10.io> wrote: > Congrats Onur, > > Can you also share the document where all known problems are listed; I am > assuming these bugs are still valid for the current stable release. > > Affan > > - Affan > > On Mon, Nov 6, 2017 at 10:24 PM, Jun Rao <j...@confluent.io> wrote: > > > Hi, everyone, > > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur > > Karaman. > > > > Onur's most significant work is the improvement of Kafka controller, > which > > is the brain of a Kafka cluster. Over time, we have accumulated quite a > few > > correctness and performance issues in the controller. There have been > > attempts to fix controller issues in isolation, which would make the code > > base more complicated without a clear path of solving all problems. Onur > is > > the one who took a holistic approach, by first documenting all known > > issues, writing down a new design, coming up with a plan to deliver the > > changes in phases and executing on it. At this point, Onur has completed > > the two most important phases: making the controller single threaded and > > changing the controller to use the async ZK api. The former fixed > multiple > > deadlocks and race conditions. The latter significantly improved the > > performance when there are many partitions. Experimental results show > that > > Onur's work reduced the controlled shutdown time by a factor of 100 times > > and the controller failover time by a factor of 3 times. > > > > Congratulations, Onur! > > > > Thanks, > > > > Jun (on behalf of the Apache Kafka PMC) > > >
