Request Permission to Contribute to Apache Kafka

2021-07-27 Thread Kai Huang
To whom it may concern, Hi, I'd like to request permission to contribute to Apache Kafka by following instructions here: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals My wiki ID: Kai Huang My Jira ID: kaihuang Can someone help grant the permission for me?

Re: Propose a KIP to report "REAL" broker/consumer fetch latency?

2021-07-27 Thread Kai Huang
Hi Ming, I will be interested in the proposed capability to diagnose Kafka latency issues and continue the discussion. Do you mind if I take over this discussion thread and follow up with the community? On 2021/04/25 17:33:10, Ming Liu wrote: > The idea I am trying right now is: > 1. Add waitT

Re: Propose a KIP to report "REAL" broker/consumer fetch latency?

2021-08-12 Thread Kai Huang
Hi Israel, Thanks for your interest in this capability. I would like to follow up on this discussion. First let me answer your last question: "Are you looking to modify the Admin API for this capability to be added?" - No, this will be a broker-side metric added to the ReplicaFetcher thread. Th

Re: [DISCUSS] KIP-736: Report the true end to end fetch latency

2021-08-17 Thread Kai Huang
Hi all, I'd like to bump up this discussion thread on KIP-736. I think this would be a useful metric from a monitoring perspective especially when troubleshooting or diagnosing issues. I've tested the fetch latency metric in Twitter's production environment, and provided some examples to illus

[DISCUSS] KIP-736: Report the true end to end fetch latency

2021-08-25 Thread Kai Huang
Hi All, I'd like to open up the discussion on a KIP-736. This is to report the "real" fetch latency by removing the effects of waiting due to replica.fetch.wait.max.ms or fetch.min.bytes. Please give it a look over and let me know what you think. https://cwiki.apache.org/confluence/display/KAFKA/K