Re: [DISCUSS] Apache Kafka 4.0.0 release

2024-12-12 Thread David Jacot
Hi Mickael/Chia-Ping, Regarding KIP-653: Upgrade log4j to log4j2, would it be possible to already merge the change while continuing to work on the system tests? Hi Calvin, Thanks for letting me know. Those patches seem reasonably small. Hence, I have fine with merging them after the feature freeze

[jira] [Created] (KAFKA-18230) admin client will fail immediately when the active controller changed

2024-12-12 Thread Luke Chen (Jira)
Luke Chen created KAFKA-18230: - Summary: admin client will fail immediately when the active controller changed Key: KAFKA-18230 URL: https://issues.apache.org/jira/browse/KAFKA-18230 Project: Kafka

[jira] [Resolved] (KAFKA-17094) Make it possible to list registered KRaft nodes in order to know which nodes should be unregistered

2024-12-12 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-17094. --- Resolution: Fixed > Make it possible to list registered KRaft nodes in order to know which nodes >

[jira] [Resolved] (KAFKA-18212) Rolling-upgrade broker causes unnecessary re-balance on classic consumer

2024-12-12 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18212. Resolution: Won't Fix > Rolling-upgrade broker causes unnecessary re-balance on classic co

[jira] [Created] (KAFKA-18229) Move configs out of "kraft" directory

2024-12-12 Thread David Arthur (Jira)
David Arthur created KAFKA-18229: Summary: Move configs out of "kraft" directory Key: KAFKA-18229 URL: https://issues.apache.org/jira/browse/KAFKA-18229 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-18228) The MetricsDuringTopicCreationDeletionTest should delete topics to ensure that the metrics are recreated.

2024-12-12 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-18228: -- Summary: The MetricsDuringTopicCreationDeletionTest should delete topics to ensure that the metrics are recreated. Key: KAFKA-18228 URL: https://issues.apache.org/jira/browse/

Re: [VOTE] KIP-1109: Unifying Kafka Consumer Topic Metrics

2024-12-12 Thread Chia-Ping Tsai
+1 (binding) Apoorv Mittal 於 2024年12月13日 週五 上午8:26寫道: > Hi All, > I would like to start vote on KIP-1109: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1109%3A+Unifying+Kafka+Consumer+Topic+Metrics > > Discussion thread: > https://lists.apache.org/thread/fvn9r9lw55lyf971k6z4qnpnmq9tm

Re: [DISCUSS] KIP-1109: Unifying Kafka Consumer Topic Metrics

2024-12-12 Thread Apoorv Mittal
Thanks Chia. I have started the voting thread: https://lists.apache.org/thread/fvn9r9lw55lyf971k6z4qnpnmq9tmm50 Regards, Apoorv Mittal On Thu, Dec 12, 2024 at 11:46 PM Chia-Ping Tsai wrote: > hi Apoorv > > Thank you for the update. It looks good to me. Perhaps we can start the > vote. > > Inc

[VOTE] KIP-1109: Unifying Kafka Consumer Topic Metrics

2024-12-12 Thread Apoorv Mittal
Hi All, I would like to start vote on KIP-1109: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1109%3A+Unifying+Kafka+Consumer+Topic+Metrics Discussion thread: https://lists.apache.org/thread/fvn9r9lw55lyf971k6z4qnpnmq9tmm50 Regards, Apoorv Mittal

[jira] [Created] (KAFKA-18227) Ensure v2 partitions are not added to last transaction during upgrade

2024-12-12 Thread Justine Olshan (Jira)
Justine Olshan created KAFKA-18227: -- Summary: Ensure v2 partitions are not added to last transaction during upgrade Key: KAFKA-18227 URL: https://issues.apache.org/jira/browse/KAFKA-18227 Project: Ka

[jira] [Created] (KAFKA-18226) Disable CustomQuotaCallbackTest and remove `isKRaftTest`

2024-12-12 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-18226: -- Summary: Disable CustomQuotaCallbackTest and remove `isKRaftTest` Key: KAFKA-18226 URL: https://issues.apache.org/jira/browse/KAFKA-18226 Project: Kafka

[jira] [Resolved] (KAFKA-18214) TestUtils#waitForCondition does not honor the maxWaitMs

2024-12-12 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18214. Fix Version/s: 4.0.0 Resolution: Fixed > TestUtils#waitForCondition does not honor

Re: [DISCUSS] KIP-1109: Unifying Kafka Consumer Topic Metrics

2024-12-12 Thread Chia-Ping Tsai
hi Apoorv Thank you for the update. It looks good to me. Perhaps we can start the vote. Including this in version *4.0* would be great. :) Best, Chia-Ping Apoorv Mittal 於 2024年12月13日 週五 上午4:16寫道: > Hi Jun and Chia, > Thanks for the feedback and review. I have updated the KIP with details. > >

[jira] [Resolved] (KAFKA-18194) Flaky test_broker_rolling_bounce due to metadata update

2024-12-12 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18194. Fix Version/s: 4.0.0 Assignee: 黃竣陽 (was: Chia-Ping Tsai) Resolution: Fixed

Re: [DISCUSS] Apache Kafka 4.0.0 release

2024-12-12 Thread Chia-Ping Tsai
hi David I have opened a blocker KAFKA-18225 to address an unsupported public API in KRaft mode. Could you please review it to determine if a quick KIP is necessary? thanks, Chia-Ping On 2024/12/11 08:45:54 David Jacot wrote: > Hi folks, > > Happy feature freeze day! Please remember that the

[RESULT] [VOTE] Release Kafka version 3.7.2

2024-12-12 Thread Matthias J. Sax
This vote passes with 8 +1 votes (4 bindings) and no 0 or -1 votes. +1 votes PMC Members: * Bill Bejeck * Divij Vaidya * Luke Chen * Matthias J. Sax Committers: * Andrew Schofield Community: * Jiunn-Yang * TengYao * Federico Valeri 0 votes * No votes -1 votes * No votes Vote thread: https://

Re: [VOTE] 3.7.2 RC1

2024-12-12 Thread Matthias J. Sax
Thanks all for verifying the RC and for voting. I am closing the vote now as accepted. Will send a follow up email with the result, and move forward with the release. Also: +1 (binding) from my side -Matthias On 12/8/24 2:47 AM, Federico Valeri wrote: Hi, thanks for running the release.

[jira] [Created] (KAFKA-18225) ClientQuotaCallback#updateClusterMetadata is unsupported by kraft

2024-12-12 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-18225: -- Summary: ClientQuotaCallback#updateClusterMetadata is unsupported by kraft Key: KAFKA-18225 URL: https://issues.apache.org/jira/browse/KAFKA-18225 Project: Kafka

Re: [DISCUSS] KIP-1034: Dead letter queue in Kafka Streams

2024-12-12 Thread Matthias J. Sax
BC6: Agreed. BC7: Like it. BC8: I personally think, `XxxHandler.Response` is fine. I don't see how `Result` is any better than `Response`? But I guess both would work. BC9: Good idea. I am wondering if we should rename the enum, too, though? We just need to give both the old and new one the

[jira] [Resolved] (KAFKA-15744) KRaft support in CustomQuotaCallbackTest

2024-12-12 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-15744. Resolution: Duplicate see KAFKA-18213 > KRaft support in CustomQuotaCallbackTest > --

Re: [VOTE] KIP-1111: Enforcing Explicit Naming for Kafka Streams Internal Topics

2024-12-12 Thread Matthias J. Sax
+1 (binding) On 12/11/24 2:57 PM, Sophie Blee-Goldman wrote: +1 (binding) thanks Sebastien! -Sophie On Tue, Dec 10, 2024 at 9:26 AM Bill Bejeck wrote: Hi Sébastien, Thanks for the KIP! +1(binding) Regards, Bill On Fri, Dec 6, 2024 at 4:33 AM Bruno Cadonna wrote: Hi Sébastien, +1 (b

Re: [DISCUSS] KIP-1111: Enforcing Explicit Naming for Kafka Streams Internal Topics

2024-12-12 Thread Matthias J. Sax
Thanks! On 12/12/24 5:53 AM, Sebastien Viale wrote: Thanks for all your remarks ! 1. I have updated the KIP to add the new parameter with importance level HIGH 2. Sophie, I will reach out to you directly via a personal message on Slack regarding the new KIP. cheers ! Sébastien __

[jira] [Created] (KAFKA-18224) StreamsResetter tool should set/validate group protocol

2024-12-12 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-18224: -- Summary: StreamsResetter tool should set/validate group protocol Key: KAFKA-18224 URL: https://issues.apache.org/jira/browse/KAFKA-18224 Project: Kafka I

[jira] [Created] (KAFKA-18223) Generate report from flaky test data

2024-12-12 Thread David Arthur (Jira)
David Arthur created KAFKA-18223: Summary: Generate report from flaky test data Key: KAFKA-18223 URL: https://issues.apache.org/jira/browse/KAFKA-18223 Project: Kafka Issue Type: Sub-task

Re: [DISCUSS] KIP-1109: Unifying Kafka Consumer Topic Metrics

2024-12-12 Thread Apoorv Mittal
Hi Jun and Chia, Thanks for the feedback and review. I have updated the KIP with details. There will be duplicate metrics as below, after the KIP, only for topics with period (.). [image: Screenshot 2024-12-12 at 15.44.37.png] Regards, Apoorv Mittal On Tue, Dec 10, 2024 at 3:46 AM Chia-Ping Ts

[jira] [Resolved] (KAFKA-18219) Use INFO level instead of ERROR after successfully performing an unclean leader election

2024-12-12 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18219. Fix Version/s: 4.0.0 Resolution: Fixed > Use INFO level instead of ERROR after succ

[jira] [Resolved] (KAFKA-18221) Set explicit consumer group protocol in streams tests

2024-12-12 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianet Magrans resolved KAFKA-18221. Resolution: Fixed > Set explicit consumer group protocol in streams tests > --

[jira] [Created] (KAFKA-18222) broker-level unclean.leader.election.enable is useless

2024-12-12 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-18222: -- Summary: broker-level unclean.leader.election.enable is useless Key: KAFKA-18222 URL: https://issues.apache.org/jira/browse/KAFKA-18222 Project: Kafka Is

[jira] [Resolved] (KAFKA-18136) Remove zk migration from code base

2024-12-12 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-18136. Fix Version/s: 4.0.0 Resolution: Fixed > Remove zk migration from code base > -

Re: [DISCUSS] Apache Kafka 4.0.0 release

2024-12-12 Thread Calvin Liu
Hi David, For KIP-966, we have 2 open PRs to complete the feature. The estimated completion time is 2 weeks, we are still trying to catch the 4.0 release. https://github.com/apache/kafka/pull/17952 https://github.com/apache/kafka/pull/18148 On Wed, Dec 11, 2024 at 12:22 PM Chia-Ping Tsai wrote:

[jira] [Created] (KAFKA-18221) Set explicit consumer group protocol in streams tests

2024-12-12 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-18221: -- Summary: Set explicit consumer group protocol in streams tests Key: KAFKA-18221 URL: https://issues.apache.org/jira/browse/KAFKA-18221 Project: Kafka Iss

[jira] [Resolved] (KAFKA-18210) Convert ConsumerRebootstrapTest to KRaft

2024-12-12 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-18210. Resolution: Duplicate > Convert ConsumerRebootstrapTest to KRaft > ---

Re: [DISCUSS] KIP-1111: Enforcing Explicit Naming for Kafka Streams Internal Topics

2024-12-12 Thread Sebastien Viale
Thanks for all your remarks ! 1. I have updated the KIP to add the new parameter with importance level HIGH 2. Sophie, I will reach out to you directly via a personal message on Slack regarding the new KIP. cheers ! Sébastien De : Sophie Blee-Goldman Envoyé

[jira] [Created] (KAFKA-18220) Refactor AsyncConsumerMetrics so they are appropriate for share consumers

2024-12-12 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-18220: Summary: Refactor AsyncConsumerMetrics so they are appropriate for share consumers Key: KAFKA-18220 URL: https://issues.apache.org/jira/browse/KAFKA-18220 Pro

[jira] [Created] (KAFKA-18219) Use INFO level instead of ERROR after successfully performing an unclean leader election

2024-12-12 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-18219: -- Summary: Use INFO level instead of ERROR after successfully performing an unclean leader election Key: KAFKA-18219 URL: https://issues.apache.org/jira/browse/KAFKA-18219