Wiki Page Request Permission

2018-01-23 Thread Litao Deng
Hey. I would like to add a KIP; however, I even can NOT see the 'Create' button on the header of the KIP home page. Could you please grant me the permission? My username is "bryan.deng" Thanks a lot!

[DISCUSS] KIP-250 Add Support for Quorum-based Producer Acknowledgment

2018-01-23 Thread Litao Deng
Hey folks. I would like to add a feature to support the quorum-based acknowledgment for the producer request. We have been running a modified version of Kafka on our testing cluster for weeks, the improvement of P999 is significant with very stable latency. Additionally, I have a proposal to achiev

[DISCUSS] KIP-250 Add Support for Quorum-based Producer Acknowledgment

2018-01-23 Thread Litao Deng
Hey folks. I would like to add a feature to support the quorum-based acknowledgment for the producer request. We have been running a modified version of Kafka on our testing cluster for weeks, the improvement of P999 is significant with very stable latency. Additionally, I have a proposal to achiev

KIP-250 Add Support for Quorum-based Producer Acknowledgment

2018-01-23 Thread Litao Deng
Hey folks. I would like to add a feature to support the quorum-based acknowledgment for the producer request. We have been running a modified version of Kafka on our testing cluster for weeks, the improvement of P999 is significant with very stable latency. Additionally, I have a proposal to achiev

Re: [DISCUSS] KIP-250 Add Support for Quorum-based Producer Acknowledgment

2018-01-24 Thread Litao Deng
7;m just wary of shipping more features (and more operational confusion) if > it's only addressing the symptom rather than the root cause. For example, > my day job's problem is we run a very high number of low-traffic > partitions-per-broker, so the fetch requests hit many partitio

Re: [DISCUSS] KIP-250 Add Support for Quorum-based Producer Acknowledgment

2018-01-24 Thread Litao Deng
he clients) and returns its LEO (call it L) > to the controller; (c) the controller issues an RPC request to the > preferred replica and waits its LEO to reach L; (d) the controller changes > the leader to the preferred replica. > > Jun > > On Wed, Jan 24, 2018 at 2:51 PM,

Re: [DISCUSS] KIP-250 Add Support for Quorum-based Producer Acknowledgment

2018-02-12 Thread Litao Deng
ailures (both A and B are > > > considered > > > >>>> wedged), this is still a regression to the current version. > > > >>>> > > > >>>> So to resolve this issue, I'd propose we can change the semantics > in > > &

Re: [DISCUSS] KIP-250 Add Support for Quorum-based Producer Acknowledgment

2018-02-12 Thread Litao Deng
se once all of the ISR replicated the message. So I am a little bit confused about "requires all replicas (not only ISRs, my previous email has an incorrect term)". Do you mean all of the replicas (ISR and the out of sync replicas) should commit the message once acks='all'? Th

[jira] [Created] (KAFKA-6477) Add Support for Quorum-based Producer Acknowledge

2018-01-23 Thread Litao Deng (JIRA)
Litao Deng created KAFKA-6477: - Summary: Add Support for Quorum-based Producer Acknowledge Key: KAFKA-6477 URL: https://issues.apache.org/jira/browse/KAFKA-6477 Project: Kafka Issue Type: New